-- Logs begin at Sun 2022-07-24 00:10:20 UTC, end at Sun 2022-07-24 01:31:39 UTC. -- Jul 24 01:02:44.803460 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Jul 24 01:02:44.812612 dv-cinder-master-3-smb devstack@n-api.service[103503]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 24 01:02:44 2022] *** Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: nodename: dv-cinder-master-3-smb Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: machine: x86_64 Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: clock source: unix Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: pcre jit disabled Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: detected number of CPU cores: 4 Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: current working directory: / Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: detected binary path: /usr/bin/uwsgi-core Jul 24 01:02:44.815025 dv-cinder-master-3-smb devstack@n-api.service[103503]: your processes number limit is 47680 Jul 24 01:02:44.815803 dv-cinder-master-3-smb devstack@n-api.service[103503]: your memory page size is 4096 bytes Jul 24 01:02:44.815803 dv-cinder-master-3-smb devstack@n-api.service[103503]: detected max file descriptor number: 2048 Jul 24 01:02:44.815803 dv-cinder-master-3-smb devstack@n-api.service[103503]: lock engine: pthread robust mutexes Jul 24 01:02:44.815803 dv-cinder-master-3-smb devstack@n-api.service[103503]: thunder lock: enabled Jul 24 01:02:44.815803 dv-cinder-master-3-smb devstack@n-api.service[103503]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 24 01:02:44.815803 dv-cinder-master-3-smb devstack@n-api.service[103503]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 24 01:02:44.857958 dv-cinder-master-3-smb devstack@n-api.service[103503]: Python main interpreter initialized at 0x5583a6bee9c0 Jul 24 01:02:44.857958 dv-cinder-master-3-smb devstack@n-api.service[103503]: python threads support enabled Jul 24 01:02:44.857958 dv-cinder-master-3-smb devstack@n-api.service[103503]: your server socket listen backlog is limited to 100 connections Jul 24 01:02:44.857958 dv-cinder-master-3-smb devstack@n-api.service[103503]: your mercy for graceful operations on workers is 90 seconds Jul 24 01:02:44.858312 dv-cinder-master-3-smb devstack@n-api.service[103503]: mapped 403077 bytes (393 KB) for 2 cores Jul 24 01:02:44.858376 dv-cinder-master-3-smb devstack@n-api.service[103503]: *** Operational MODE: preforking *** Jul 24 01:02:44.858629 dv-cinder-master-3-smb devstack@n-api.service[103503]: *** uWSGI is running in multiple interpreter mode *** Jul 24 01:02:44.858629 dv-cinder-master-3-smb devstack@n-api.service[103503]: spawned uWSGI master process (pid: 103503) Jul 24 01:02:44.858832 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Jul 24 01:02:44.859931 dv-cinder-master-3-smb devstack@n-api.service[103503]: spawned uWSGI worker 1 (pid: 103504, cores: 1) Jul 24 01:02:44.859931 dv-cinder-master-3-smb devstack@n-api.service[103503]: spawned uWSGI worker 2 (pid: 103505, cores: 1) Jul 24 01:02:44.859931 dv-cinder-master-3-smb devstack@n-api.service[103503]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 24 01:02:45.505130 dv-cinder-master-3-smb devstack@n-api.service[103505]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 24 01:02:45.506808 dv-cinder-master-3-smb devstack@n-api.service[103504]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 24 01:02:46.607234 dv-cinder-master-3-smb devstack@n-api.service[103505]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:02:46.607234 dv-cinder-master-3-smb devstack@n-api.service[103505]: from cryptography.utils import int_from_bytes Jul 24 01:02:46.607884 dv-cinder-master-3-smb devstack@n-api.service[103505]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:02:46.607884 dv-cinder-master-3-smb devstack@n-api.service[103505]: from cryptography.utils import int_from_bytes Jul 24 01:02:46.608059 dv-cinder-master-3-smb devstack@n-api.service[103504]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:02:46.608059 dv-cinder-master-3-smb devstack@n-api.service[103504]: from cryptography.utils import int_from_bytes Jul 24 01:02:46.608439 dv-cinder-master-3-smb devstack@n-api.service[103504]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:02:46.608439 dv-cinder-master-3-smb devstack@n-api.service[103504]: from cryptography.utils import int_from_bytes Jul 24 01:02:49.032445 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 01:02:49.033035 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 01:02:49.033379 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 01:02:49.033464 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 01:02:49.033532 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 01:02:49.033598 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 01:02:49.033672 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 01:02:49.033754 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 01:02:49.033851 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 01:02:49.034092 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 01:02:49.034234 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.034400 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.034516 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.034724 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.034852 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.035005 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.035102 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.035346 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.035456 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.035680 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.035811 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.035959 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.036065 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.036295 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.036437 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.036620 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.036905 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.037119 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.037269 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.037519 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.037833 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.037963 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.038068 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.038157 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.038417 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.038548 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.038725 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.038854 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.039029 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.039160 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.039391 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.039540 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.039679 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.039802 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.039924 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.040111 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.041377 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.041511 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.041635 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.041635 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.041864 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.041864 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.042093 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.042238 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.042370 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.042502 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.042633 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.042754 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.042871 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.042997 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.043124 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.043245 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.043407 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.043539 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.043662 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.043782 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.043903 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.044041 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.044172 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.044296 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.044406 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.044533 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.044665 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.044786 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.044907 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.045036 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.045166 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.045287 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.045415 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.045551 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.045687 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.045811 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.046015 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.046149 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.046271 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.046402 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.046609 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.046816 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.046952 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.047078 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.047208 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.047368 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.047543 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.047675 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.047892 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.048081 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.048227 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.048352 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.048478 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.048600 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.048769 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.048909 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.049046 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.049176 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.049380 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.049575 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.049721 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.049848 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.049986 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.050110 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.050231 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.050352 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.050473 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.050603 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.050773 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.050902 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.051035 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.051161 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.051281 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.051459 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.051632 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.051766 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.051932 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.052090 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.052216 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.052344 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.052534 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.052714 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.052848 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.052985 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.053121 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.053252 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.053375 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.053504 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.053707 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.053886 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.054035 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.054164 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.054297 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.054420 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.054547 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.054685 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.054888 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.055067 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.055199 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.055354 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.055480 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.055627 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.055791 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.055923 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.056109 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.056245 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.056440 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.056629 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.056775 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.057027 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.057205 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.057339 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.057464 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.057634 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.057763 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.057952 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.058092 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.058279 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.058417 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.058541 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.058669 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.058857 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.058989 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.059155 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.059355 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.059507 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.059632 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.059819 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.059947 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.060109 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.060252 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.060376 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.060497 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.060618 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.060739 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.060933 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.061073 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.061249 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.061363 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.061552 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.061681 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.061854 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.061999 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.062124 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.062244 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.062435 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.062565 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.063075 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.063215 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.063408 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.063598 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.063731 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.063852 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.063986 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.064109 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.064276 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.064411 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.064582 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.064722 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.064940 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.065072 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.065195 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.065323 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.065446 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.065580 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.065715 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.065837 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.066032 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.066171 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.066339 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.066480 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.066633 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.066762 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.066947 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.067083 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.067235 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.067436 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.067574 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.067707 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.067899 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.068028 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.068199 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.068335 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.068497 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.068622 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.068782 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.068920 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.069095 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.069221 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.069389 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.069515 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.069692 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.069822 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.069988 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.070125 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.070311 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.070439 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.070562 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.070683 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.070876 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.071014 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.071192 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.071342 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.071517 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.071645 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.071816 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.071958 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.072082 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.072209 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.072401 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.072537 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.072700 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.072926 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.073054 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.073301 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.073429 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.073600 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.073739 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.073873 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.073997 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.074186 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.074315 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.074475 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.074617 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.074793 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.074930 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.075083 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.075212 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.075419 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.075562 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.075737 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.075882 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.076016 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.076145 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.076349 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.076490 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.076644 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.076774 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.076963 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.077092 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.077274 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:02:49.077410 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.077608 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.077744 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.077935 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.078062 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.078254 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.078382 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.078559 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.078686 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.078870 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.079009 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.079198 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.079361 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.079544 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.079753 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.079881 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.080077 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.080217 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.080395 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.080524 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.080722 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.080850 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.081071 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.081198 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.081356 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.081485 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.081685 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.081824 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.082002 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.082146 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.082300 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.082429 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.082621 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.082750 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.082949 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.083079 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.083391 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.083520 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.083644 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.083778 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.083942 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.084082 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.084278 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.084408 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.084586 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.084715 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.084905 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.085040 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.085218 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.085347 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.085489 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.085610 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.085811 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.085936 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.086114 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.086258 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.086412 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.086549 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.086769 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.086905 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.087069 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.087198 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.087411 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.087558 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.087713 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.087842 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.088031 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.088159 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.088339 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.088483 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.088615 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.088746 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.088941 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.089070 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.089267 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.089405 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.089566 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.089693 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.089883 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.090011 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.090197 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.090327 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.090506 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.090636 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.090816 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.090959 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.091092 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.091223 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.091409 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.091536 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.091732 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.091861 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.092026 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.092156 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.092338 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.092475 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.092647 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.092783 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.092915 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.093038 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.093249 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.093378 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.093549 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.093685 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.093852 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.093982 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.094163 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.094299 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.094453 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.094590 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.094778 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.094906 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.095077 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.095206 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.095405 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.095549 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.095674 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.095809 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.096024 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.096198 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.096327 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.096631 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.096785 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.096911 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.097191 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.097317 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.097507 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.097639 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.097816 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.097941 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.098122 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.098248 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.098446 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.098572 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.098778 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.098903 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.099083 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.099207 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.099428 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.099567 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.099738 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.099864 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.100039 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.100164 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.100352 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.100485 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.100659 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.100783 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.100972 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.101105 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.101285 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.101414 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.101591 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.101720 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.101938 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.102077 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.102230 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.102356 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.102531 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.102655 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.102851 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.102986 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.103173 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.103345 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.103501 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.103619 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.103802 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.103902 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.104109 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.104196 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.104414 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.104500 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.104716 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.104804 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.105019 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.105116 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.105320 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.105405 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.105616 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.105701 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.105918 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.106003 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.106216 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.106309 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.106515 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.106600 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.106813 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.106937 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.107110 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.107235 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.107438 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.107559 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.107739 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.107866 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.108043 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.108181 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.108342 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.108477 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.108643 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.108766 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.108955 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.109091 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.109243 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.109377 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.109589 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.109715 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.109893 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.110027 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.110217 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.110341 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.110527 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.110652 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.110838 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.110972 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.111147 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.111271 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.111482 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.111619 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.111792 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.112007 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.112139 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.112321 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.112457 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.112644 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.112790 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.112956 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.113081 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.113270 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.113394 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.113590 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.113729 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.113894 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.114018 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.114211 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.114347 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.114578 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.114785 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.114911 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.115033 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.115203 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.115346 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.115553 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.115696 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.115860 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.115986 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.116175 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.116300 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.116481 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.116604 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.116798 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.116923 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.117102 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.117227 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.117409 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.117543 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.117717 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.117842 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.118028 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.118152 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.118332 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.118456 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.118635 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.118760 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.118942 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.119066 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.119244 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.119433 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.119587 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.119712 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.119896 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.120021 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.120210 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.120337 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.120512 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.120637 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.120822 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.120957 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.121149 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.121285 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.121476 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.121602 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.121781 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.121916 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.122090 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.122214 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.122405 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.122528 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.122712 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.122847 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.123018 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.123342 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.123650 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.123773 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.123958 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.124265 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.124389 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.124575 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.124700 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.124880 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.125020 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.125184 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.125309 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.125484 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.125616 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.125791 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.125925 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.126096 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.126221 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.126397 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.126709 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.126837 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.127018 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.127364 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.127580 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.127706 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.127905 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.128030 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.128221 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.128354 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.128530 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.128657 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.128848 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.128989 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.129163 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.129289 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.129466 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.129597 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.129770 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.130097 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.130223 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.130401 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.130741 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.130864 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.131048 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.131188 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.131371 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.131524 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.131686 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.131853 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.132002 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.132186 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.132313 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.132495 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.132619 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.132898 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.133174 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.133318 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.133511 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.133822 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.133952 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.134128 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.134266 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.134442 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.134568 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.134748 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.134874 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.135056 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.135189 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.135388 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.135516 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.135707 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.135831 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.136015 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.136153 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.136321 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.136447 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.136631 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.136755 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.136931 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.137056 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.137238 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.137363 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.137550 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.137673 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.137860 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.138125 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.138259 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.138461 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.138585 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.138773 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.138917 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.139082 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.139206 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.139418 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.139556 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.139731 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.139866 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.140042 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.140176 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.140363 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.140499 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.140670 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.140804 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.140980 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.141116 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.141286 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.141418 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.141587 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.141711 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.141886 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.142010 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.142193 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.142311 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.142494 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.142789 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.142918 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.143086 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.143218 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.143416 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.143543 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.143717 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.143857 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.144019 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.144140 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.144319 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.144451 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.144619 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.144745 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.144931 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.145064 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.145231 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.145359 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.145537 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.145757 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.145889 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.146079 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.146204 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.146389 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.146514 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.146694 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.146820 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.147004 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.147131 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.147322 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.147464 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.147638 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.147764 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.147941 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.148061 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.148249 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.148389 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.148551 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.148684 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.148855 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.148980 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.149157 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.149297 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.149461 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.149586 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.149774 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.149907 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.150077 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.150216 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.150374 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.150500 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.150673 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.150798 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.150978 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.151112 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.151283 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.151425 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.151604 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.151768 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.151908 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.152032 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.152191 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.152324 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.152497 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.152630 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.152803 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.152929 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.153099 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.153225 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.153406 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.153532 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.153705 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.153831 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.154015 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.154140 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.154319 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.154454 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.154616 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.154749 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.154912 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.155041 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.155214 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.155385 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.155541 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.155670 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.155839 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.155973 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.156141 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.156276 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.156439 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.156571 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.156751 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.156884 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.157048 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.157183 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.157348 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.157473 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.157647 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.157793 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.157926 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.158047 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.158233 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.158360 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.158528 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.158653 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.158839 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.158964 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.159143 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.159267 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.159466 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.159590 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.159766 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.159902 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.160069 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.160203 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.160369 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.160494 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.160667 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.160804 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.160971 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.161097 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.161307 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.161447 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.161615 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.161749 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.161914 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.162047 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.162216 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.162403 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.162535 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.162656 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.162801 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.162925 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.163100 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.163236 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.163422 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.163547 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.163718 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.163846 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.164017 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.164153 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.164316 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.164448 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.164611 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.164735 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.164904 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.165030 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.165203 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.165327 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.165503 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.165638 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.165801 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.165926 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.166102 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.166229 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.166401 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.166525 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.166703 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.166827 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.167009 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.167134 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.167325 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.167455 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.167633 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.167760 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.167936 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.168063 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.168243 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.168444 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.168604 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.168728 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.168849 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.168971 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.169115 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.169249 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.169442 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.169571 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.169701 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.169823 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.170013 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.170148 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.170316 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.170474 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.170597 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.170717 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.170899 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.171035 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.171195 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.171348 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.171534 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.171658 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.171844 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.171977 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.172162 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.172289 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.172482 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.172605 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.172797 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.172922 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.173095 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.173219 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.173400 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.173533 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.173707 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.173832 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.174008 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.174133 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.174307 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.174431 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.174608 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.174740 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.174914 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.175042 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.175219 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.175399 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.175542 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.175664 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.175840 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.175966 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.176149 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.176284 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.176457 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.176581 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.176760 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.176965 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.177102 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.177396 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.177518 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.177712 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.177837 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.178018 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.178143 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.178318 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.178444 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.178623 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.178747 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.178922 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.179045 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.179228 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.179371 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.179553 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.179689 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.179868 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.180010 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.180177 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.180302 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.180489 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.180616 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.180802 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.180941 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.181113 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.181241 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.181422 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.181547 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.181727 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.181862 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.182032 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.182156 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.182332 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.182465 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.182632 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.182766 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.182961 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.183093 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.183268 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.183438 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.183596 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.183724 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.183901 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.184026 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.184205 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.184331 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.184512 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.184637 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.184811 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.184936 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.185120 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.185252 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.185420 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.185546 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.185720 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.185847 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.186041 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.186174 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.186344 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.186470 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.186667 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.186792 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.186997 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.187130 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.187320 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.187449 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.187636 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.188125 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.188411 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.188547 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.188722 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.188849 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.189026 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.189150 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.189334 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.189470 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.189636 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.189762 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.189937 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.190065 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.190240 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.190372 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.190548 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.190673 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.190845 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.190975 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.191147 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.191274 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.191490 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.191623 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.191801 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.191926 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.192110 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.192237 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.192411 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.192558 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.192754 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.192881 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.193075 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.193216 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.193389 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.193528 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.193708 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.193834 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.194114 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.194240 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.194434 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.194558 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.194739 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.194870 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.195056 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.195181 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.195380 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.195506 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.195690 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.195814 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.195992 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.196136 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.196301 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.196435 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.196610 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.196736 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.196912 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.197046 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.197236 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.197365 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.197537 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.197663 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.197837 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.197970 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.198145 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.198269 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.198450 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.198586 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.198751 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.198890 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.199053 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.199180 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.199407 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.199547 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.199714 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.199840 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.200033 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.200159 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.200343 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.200468 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.200662 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.200788 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.200979 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.201105 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.201279 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.201403 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.201588 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.201715 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.201889 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.202015 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.202188 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.202312 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.202488 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.202624 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.202790 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.202923 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.203216 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.203394 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.203509 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.203631 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.203754 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.203877 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.203998 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.204128 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.204292 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.204418 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.204612 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.204739 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.204915 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.205055 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.205236 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.205362 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.205546 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.205679 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.205866 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.206001 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.206182 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.206306 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.206482 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.206607 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.206780 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.206906 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.207086 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.207218 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.207409 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.207534 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.207715 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.207843 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.207996 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.208144 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.208382 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.208512 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.208686 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.208811 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.208980 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.209140 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.209264 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.209386 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.209580 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.209715 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.209880 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.210008 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.210198 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.210333 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.210502 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.210635 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.210804 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.210931 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.211106 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.211241 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.211436 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.211562 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.211759 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.211886 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.212059 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.212194 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.212361 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.212486 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.212669 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.212795 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.212972 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.213100 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.213275 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.213401 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.213580 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.213707 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.213881 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.214007 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.214183 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.214317 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.214484 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.214609 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.214807 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.214933 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.215087 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.215214 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.215422 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.215561 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.215726 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.215852 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.216029 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.216155 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.216332 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.216465 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.216630 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.216756 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.216946 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.217071 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.217258 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.217392 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.217589 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.217767 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.217894 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.218098 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.218224 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.218409 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.218545 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.218719 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.218844 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.219029 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.219155 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.219361 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.219492 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.219677 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.219812 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.219984 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.220120 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.220290 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.220417 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.220594 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.220720 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.220898 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.221033 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.221220 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.221347 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.221531 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.221655 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.221846 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.222049 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.222176 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.222298 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.222463 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.222591 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.222770 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.222980 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.223100 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.223392 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.223522 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.223735 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.223878 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.224050 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.224185 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.224362 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.224494 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.224674 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.224807 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.224982 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.225107 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.225290 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.225416 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.225595 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.225721 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.225901 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.226026 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.226207 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.226339 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.226524 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.226651 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.226831 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.226957 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.227137 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.227263 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.227472 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.227600 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.227782 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.227909 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.228096 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.228229 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.228411 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.228545 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.228724 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.228844 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.229034 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.229167 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.229346 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.229473 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.229660 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.229785 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.229975 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.230181 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.230308 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.230501 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.230627 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.230833 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.230969 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.231157 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.231341 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.231507 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.231643 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.231820 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.231960 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.232132 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.232257 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.232440 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.232565 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.232744 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.232881 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.233046 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.233166 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.233353 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.233472 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.233659 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.233799 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.233959 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.234095 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.234275 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.234404 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.234580 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.234707 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.234880 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.235005 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.235195 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.235425 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.235565 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.235747 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.236036 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.236172 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.236386 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.236519 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.236700 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.236834 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.237013 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.237137 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.237330 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.237463 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.237642 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.237768 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.237943 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.238077 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.238244 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.238378 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.238551 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.238675 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.238852 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.238977 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.239152 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.239286 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.239533 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.239654 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.239817 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.239942 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.240116 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.240254 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.240422 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.240548 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.240725 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.240849 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.241020 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.241257 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.241391 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.241603 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.241730 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.241917 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.242061 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.242220 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.242353 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.242520 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.242646 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.242818 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.242953 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.243125 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.243262 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.243450 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.243590 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.243751 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.243878 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.244051 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.244185 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.244348 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.244473 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.244657 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.244789 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.244952 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.245077 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.245250 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.245382 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.245547 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.245673 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.245852 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.245984 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.246147 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.246271 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.246450 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.246575 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.246752 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.246877 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.247075 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.247209 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.247401 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.247527 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.247704 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.247831 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.248006 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.248147 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.248310 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.248434 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.248610 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.248734 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.248913 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.249044 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.249216 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.249343 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.249515 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.249640 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.249826 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.249960 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.250127 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.250363 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.250495 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.250692 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.250898 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.251025 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.251150 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.251314 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.251442 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.251629 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.251806 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.251941 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.252070 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.252227 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.252359 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.252528 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.252666 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.252847 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.252985 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.253155 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.253281 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.253460 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.253593 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.253762 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.253885 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.254070 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.254196 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.254375 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.254502 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.254678 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.254803 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.255006 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.255134 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.255325 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.255599 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.255734 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.255920 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.256044 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.256226 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.256365 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.256540 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.256666 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.256844 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.256969 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.257155 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.257294 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.257463 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.257588 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.257768 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.257902 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.258088 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.258215 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.258395 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.258519 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.258704 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.258831 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.259008 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.259134 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.259334 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.259462 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.259645 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.259769 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.259963 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.260095 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.260248 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.260368 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.260557 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.260692 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.260865 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.260991 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.261162 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.261279 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.261467 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.261606 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.261782 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.261915 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.262089 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.262214 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.262399 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.262539 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.262736 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.262863 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.263051 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.263183 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.263388 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.263510 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.263693 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.263817 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.264005 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.264131 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.264306 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.264432 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.264612 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.264736 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.264921 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.265053 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.265226 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.265355 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.265538 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.265664 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.265841 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.265964 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.266142 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.266269 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.266446 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.266580 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.266749 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.266884 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.267064 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.267190 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.267391 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.267519 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.267691 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.267835 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.267988 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.268114 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.268293 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.268426 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.268591 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.268758 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.268881 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.269003 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.269173 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.269299 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.269471 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.269626 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.269757 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.269880 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.270054 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.270187 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.270351 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.270503 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.270697 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.270859 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.270985 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.271167 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.271325 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.271504 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.271630 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.271813 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.271949 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.272119 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.272253 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.272435 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.272569 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.272729 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.272854 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.273026 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.273153 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.273322 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.273454 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.273628 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.273753 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.273929 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.274055 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.274233 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.274358 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.274532 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.274665 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.274832 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.274959 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.275136 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.275262 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.275469 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.275607 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.275761 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.275886 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.276060 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.276186 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.276359 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.276494 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.276656 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.276782 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.276953 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.277079 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.277258 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.277393 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.277558 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.277685 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.277859 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.277992 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.278159 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.278298 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.278457 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.278590 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.278756 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.278887 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.279089 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.279216 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.279406 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.279536 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.279708 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.279832 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.280023 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.280149 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.280333 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.280458 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.280644 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.280776 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.280946 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.281070 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.281250 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.281374 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.281570 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.281703 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.281874 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.281999 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.282175 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.282307 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.282474 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.282611 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.282780 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.282914 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.283087 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.283219 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.283419 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.283557 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.283727 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.283850 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.284030 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.284155 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.284338 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.284466 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.284644 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.284767 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.284965 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.285091 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.285267 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.285391 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.285576 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.285700 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.285891 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.286022 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.286228 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.286357 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.286546 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.286679 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.286856 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.286981 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.287181 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.287326 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.287520 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.287646 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.287825 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.287963 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.288129 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.288253 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.288427 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.288551 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.288684 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 01:02:49.288821 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.289030 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.289338 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.289646 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.289961 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.290270 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.290596 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.290920 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.291227 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.291581 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.291904 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.292247 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.292560 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.292901 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.293228 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.293539 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.293850 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.294152 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:02:49.294391 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 01:02:49.350187 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO dbcounter [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Registered counter for database nova_api Jul 24 01:02:49.355743 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO dbcounter [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Registered counter for database nova_api Jul 24 01:02:49.470020 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG oslo_db.sqlalchemy.engines [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:02:49.471261 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_db.sqlalchemy.engines [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:02:49.474504 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writer thread running {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:02:49.478517 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writer thread running {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:02:49.529722 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.context [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0485860-44f6-4783-97a7-f4dbef82a919(cell1) {{(pid=103505) load_cells /opt/stack/nova/nova/context.py:464}} Jul 24 01:02:49.533366 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.context [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0485860-44f6-4783-97a7-f4dbef82a919(cell1) {{(pid=103504) load_cells /opt/stack/nova/nova/context.py:464}} Jul 24 01:02:49.533694 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG oslo_concurrency.lockutils [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:02:49.535274 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG oslo_concurrency.lockutils [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:02:49.536076 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG oslo_concurrency.lockutils [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:02:49.537378 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:02:49.538235 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG oslo_concurrency.lockutils [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:02:49.539105 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:02:49.539919 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:02:49.540239 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO dbcounter [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Registered counter for database nova_cell0 Jul 24 01:02:49.542009 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:02:49.544011 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO dbcounter [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Registered counter for database nova_cell0 Jul 24 01:02:49.544145 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO dbcounter [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Registered counter for database nova_cell1 Jul 24 01:02:49.548006 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO dbcounter [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Registered counter for database nova_cell1 Jul 24 01:02:49.552246 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG oslo_db.sqlalchemy.engines [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:02:49.553733 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG oslo_db.sqlalchemy.engines [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:02:49.556525 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_db.sqlalchemy.engines [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:02:49.559767 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writer thread running {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:02:49.560004 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_db.sqlalchemy.engines [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:02:49.563813 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writer thread running {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:02:49.697924 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writer thread running {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:02:49.700135 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writer thread running {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:02:49.708655 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO dbcounter [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Registered counter for database nova_cell0 Jul 24 01:02:49.710379 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO dbcounter [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Registered counter for database nova_cell0 Jul 24 01:02:49.719877 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG oslo_db.sqlalchemy.engines [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:02:49.723501 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_db.sqlalchemy.engines [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:02:49.724460 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writer thread running {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:02:49.728442 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writer thread running {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:02:50.055711 dv-cinder-master-3-smb devstack@n-api.service[103504]: WARNING keystonemiddleware.auth_token [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:02:50.059052 dv-cinder-master-3-smb devstack@n-api.service[103505]: WARNING keystonemiddleware.auth_token [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:02:50.063335 dv-cinder-master-3-smb devstack@n-api.service[103504]: WARNING keystonemiddleware.auth_token [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:02:50.066776 dv-cinder-master-3-smb devstack@n-api.service[103505]: WARNING keystonemiddleware.auth_token [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:02:50.400893 dv-cinder-master-3-smb devstack@n-api.service[103504]: WARNING keystonemiddleware.auth_token [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:02:50.406911 dv-cinder-master-3-smb devstack@n-api.service[103504]: WARNING keystonemiddleware.auth_token [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:02:50.408615 dv-cinder-master-3-smb devstack@n-api.service[103505]: WARNING keystonemiddleware.auth_token [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:02:50.412202 dv-cinder-master-3-smb devstack@n-api.service[103504]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5583a6bee9c0 pid: 103504 (default app) Jul 24 01:02:50.414239 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:02:50.414682 dv-cinder-master-3-smb devstack@n-api.service[103505]: WARNING keystonemiddleware.auth_token [None req-7e2753e1-1a76-4fb9-81a9-4cae64a16f52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:02:50.415452 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Jul 24 01:02:50.415866 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Sun Jul 24 01:02:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:02:50.419972 dv-cinder-master-3-smb devstack@n-api.service[103505]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5583a6bee9c0 pid: 103505 (default app) Jul 24 01:04:06.045110 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:06.046141 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 24 01:04:06.046532 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:06.059310 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writing DB stats nova_api:SELECT=3 {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:06.060183 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writing DB stats nova_cell0:SELECT=3 {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:06.060909 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writing DB stats nova_cell1:SELECT=3 {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:06.062160 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:06.911503 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-b9cbd38d-1f6f-4549-94fe-d75527d20d45 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:06.942160 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-b9cbd38d-1f6f-4549-94fe-d75527d20d45 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.888538 Jul 24 01:04:06.942925 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Sun Jul 24 01:04:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:04:09.167392 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:09.168657 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-f76eb220-7aa0-4bfd-865f-cc435c545741 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 Jul 24 01:04:09.169278 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:09.633171 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-64196845-cb84-442d-8820-f92fead3b10f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "swap": 0, "name": "cirros256"}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:09.651172 dv-cinder-master-3-smb devstack@n-api.service[103505]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:04:09.651172 dv-cinder-master-3-smb devstack@n-api.service[103505]: warnings.warn(msg) Jul 24 01:04:09.689557 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-64196845-cb84-442d-8820-f92fead3b10f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.513959 Jul 24 01:04:09.690411 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:04:09.704706 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_api:SELECT=3 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:09.705680 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_cell0:SELECT=3 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:09.706468 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_cell1:SELECT=3 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:09.707249 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:09.909719 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-368ec299-b84c-4e5b-a6ce-e78584219d99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:09.912237 dv-cinder-master-3-smb devstack@n-api.service[103504]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:04:09.912237 dv-cinder-master-3-smb devstack@n-api.service[103504]: warnings.warn(msg) Jul 24 01:04:09.976371 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-368ec299-b84c-4e5b-a6ce-e78584219d99 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277835 Jul 24 01:04:09.976977 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Sun Jul 24 01:04:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:04:12.238411 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-64196845-cb84-442d-8820-f92fead3b10f admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:12.239647 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-64196845-cb84-442d-8820-f92fead3b10f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Jul 24 01:04:12.240279 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:12.883432 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-8b95303b-618b-4402-a54c-0b96b6b58dd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:12.901051 dv-cinder-master-3-smb devstack@n-api.service[103504]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:04:12.901051 dv-cinder-master-3-smb devstack@n-api.service[103504]: warnings.warn(msg) Jul 24 01:04:12.923161 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-8b95303b-618b-4402-a54c-0b96b6b58dd3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676820 Jul 24 01:04:12.923952 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:04:12.935810 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-d856d387-14bf-454f-96c7-7adc168c3ef8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:12.937759 dv-cinder-master-3-smb devstack@n-api.service[103505]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:04:12.937759 dv-cinder-master-3-smb devstack@n-api.service[103505]: warnings.warn(msg) Jul 24 01:04:12.971316 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-d856d387-14bf-454f-96c7-7adc168c3ef8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039068 Jul 24 01:04:12.972216 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Sun Jul 24 01:04:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:04:15.185884 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-8b95303b-618b-4402-a54c-0b96b6b58dd3 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:15.187935 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-8b95303b-618b-4402-a54c-0b96b6b58dd3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Jul 24 01:04:15.191960 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:15 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:15.592286 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-6130de18-6dbc-4130-88e4-7e8a01369ef7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "name": "ds1G"}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:15.612148 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-6130de18-6dbc-4130-88e4-7e8a01369ef7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418404 Jul 24 01:04:15.612687 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:04:15.625221 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-6e28374c-3ec2-4bb4-b220-eca7cee164b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:15.650974 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-6e28374c-3ec2-4bb4-b220-eca7cee164b4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029805 Jul 24 01:04:15.651670 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Sun Jul 24 01:04:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:04:17.878143 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-6130de18-6dbc-4130-88e4-7e8a01369ef7 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:17.879277 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-6130de18-6dbc-4130-88e4-7e8a01369ef7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Jul 24 01:04:17.879771 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:18.333308 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-d4dfad03-bb13-4f6d-bb9a-c3c024bee936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "swap": 0}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:18.355434 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-d4dfad03-bb13-4f6d-bb9a-c3c024bee936 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469764 Jul 24 01:04:18.355990 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:04:18.368110 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-673a7176-537b-40a5-81ac-ca14ce8b4c42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:18.391661 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-673a7176-537b-40a5-81ac-ca14ce8b4c42 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027256 Jul 24 01:04:18.392241 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Sun Jul 24 01:04:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:04:20.645054 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-d4dfad03-bb13-4f6d-bb9a-c3c024bee936 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:20.646065 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-d4dfad03-bb13-4f6d-bb9a-c3c024bee936 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 24 01:04:20.646432 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:21.090663 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-7da01a87-aa75-4fb7-826f-69575bd72340 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G"}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:21.110157 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-7da01a87-aa75-4fb7-826f-69575bd72340 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457750 Jul 24 01:04:21.117915 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:04:21.123063 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-443db4d0-c198-4d5f-b84b-6b40ac1f7594 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:21.148107 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-443db4d0-c198-4d5f-b84b-6b40ac1f7594 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028821 Jul 24 01:04:21.149049 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Sun Jul 24 01:04:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:04:23.428362 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-7da01a87-aa75-4fb7-826f-69575bd72340 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:23.429955 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-7da01a87-aa75-4fb7-826f-69575bd72340 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002265 Jul 24 01:04:23.430575 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:23.873524 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-780ed482-b461-47bd-a416-4ff49f1a6840 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:23.898484 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-780ed482-b461-47bd-a416-4ff49f1a6840 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.459475 Jul 24 01:04:23.899070 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Sun Jul 24 01:04:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:04:26.590235 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-7da01a87-aa75-4fb7-826f-69575bd72340 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:26.591453 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-7da01a87-aa75-4fb7-826f-69575bd72340 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Jul 24 01:04:26.591874 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:27.147127 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-9663ae9e-b1ff-45cc-b293-bd5af114a872 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny"}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:27.167919 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-9663ae9e-b1ff-45cc-b293-bd5af114a872 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.568393 Jul 24 01:04:27.168494 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:04:27.185181 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-5d9abba4-5f68-4d94-9a76-0619f6394cb7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:27.216041 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-5d9abba4-5f68-4d94-9a76-0619f6394cb7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035982 Jul 24 01:04:27.216801 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Sun Jul 24 01:04:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:04:29.564751 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-9663ae9e-b1ff-45cc-b293-bd5af114a872 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:29.565873 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-9663ae9e-b1ff-45cc-b293-bd5af114a872 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jul 24 01:04:29.566464 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:29.978399 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-c70af8e5-255f-4431-9994-c0527beac9d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:29.996963 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-c70af8e5-255f-4431-9994-c0527beac9d1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424224 Jul 24 01:04:29.997512 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:04:30.009302 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-210dcd5f-15ae-43b3-89b7-d692c25e8700 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:30.031976 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-210dcd5f-15ae-43b3-89b7-d692c25e8700 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026276 Jul 24 01:04:30.032538 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Sun Jul 24 01:04:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:04:32.221481 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-c70af8e5-255f-4431-9994-c0527beac9d1 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:32.222515 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-c70af8e5-255f-4431-9994-c0527beac9d1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 24 01:04:32.222906 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:32.618779 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-ef70b96c-1ebf-44ab-9445-48f34ed2c02b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:32.649056 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-ef70b96c-1ebf-44ab-9445-48f34ed2c02b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.420193 Jul 24 01:04:32.649833 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:04:32.663761 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-9a1e22dc-e0cc-489d-8c91-04e13db80982 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:32.690118 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-9a1e22dc-e0cc-489d-8c91-04e13db80982 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029989 Jul 24 01:04:32.690721 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Sun Jul 24 01:04:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:04:34.981346 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-ef70b96c-1ebf-44ab-9445-48f34ed2c02b admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:34.982695 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-ef70b96c-1ebf-44ab-9445-48f34ed2c02b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001809 Jul 24 01:04:34.983181 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:35.409230 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-5ecefbf8-85d6-4354-bc0a-ce679da41b3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "ram": 8192}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:35.430161 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-5ecefbf8-85d6-4354-bc0a-ce679da41b3b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.440975 Jul 24 01:04:35.431039 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:04:35.443696 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-16559fde-a459-4563-8ef8-778350a927ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:35.468411 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-16559fde-a459-4563-8ef8-778350a927ec admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028909 Jul 24 01:04:35.468986 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Sun Jul 24 01:04:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:04:37.747925 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-5ecefbf8-85d6-4354-bc0a-ce679da41b3b admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:37.749654 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-5ecefbf8-85d6-4354-bc0a-ce679da41b3b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003215 Jul 24 01:04:37.750238 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:04:38.265351 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-d57239f5-7059-4267-bb88-a84d3cfff16d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:38.288058 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-d57239f5-7059-4267-bb88-a84d3cfff16d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.530868 Jul 24 01:04:38.290356 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Sun Jul 24 01:04:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:04:38.302557 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-24fe5b46-0ad0-4240-b250-fe0f4b9fb049 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:04:38.306218 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:38.332439 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-24fe5b46-0ad0-4240-b250-fe0f4b9fb049 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033835 Jul 24 01:04:38.333418 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Sun Jul 24 01:04:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:04:57.195331 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-d57239f5-7059-4267-bb88-a84d3cfff16d admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:57.196853 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-d57239f5-7059-4267-bb88-a84d3cfff16d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Jul 24 01:04:57.197448 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:04:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:57.625822 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-841a7bf9-d8c5-40a2-ae05-ca0ffbaf9e53 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:57.643709 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-841a7bf9-d8c5-40a2-ae05-ca0ffbaf9e53 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.439593 Jul 24 01:04:57.644246 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Sun Jul 24 01:04:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:04:58.742482 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-d57239f5-7059-4267-bb88-a84d3cfff16d admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:58.743524 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-d57239f5-7059-4267-bb88-a84d3cfff16d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 24 01:04:58.743913 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:04:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:04:59.314594 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-3e51b007-f6a3-481f-9749-70c86bd6f587 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:59.323194 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.wsgi [None req-3e51b007-f6a3-481f-9749-70c86bd6f587 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-3e51b007-f6a3-481f-9749-70c86bd6f587 admin admin] Request method failure captured: Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: Accept: application/json Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: Accept-Encoding: gzip, deflate Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: Connection: keep-alive Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: Content-Length: 0 Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: Host: 10.222.0.42 Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: Openstack-Api-Version: compute 2.90 Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: Openstack-System-Scope: None Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: User-Agent: python-novaclient Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Auth-Token: gAAAAABi3Jq66dGI-DuwTuo020pFFOK2zXOK-9L5XoljcikpHou1Vz9eRjbEV-eqeUwIDzCb8K6byYumABG8yQ6PcZrbj92s37r63bnvjnJ2ylBv7ypX_KcubU2SmjWThdJLzD75VpI5AqaMC01ljSoH4sSkq47Hi0ch0LnaEzXRPjTr--0KsVM Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Domain-Id: None Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Domain-Name: None Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Identity-Status: Confirmed Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Is-Admin-Project: True Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Domain-Id: default Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Domain-Name: Default Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Name: admin Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Role: admin,reader,member Jul 24 01:04:59.328339 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Roles: admin,reader,member Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05a6eda2714c497da6528545bd5b3ebc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}] Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Tenant: admin Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Tenant-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Tenant-Name: admin Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User: admin Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Domain-Id: default Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Domain-Name: Default Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Id: bd7e825180504b9cb4f914bcf260106f Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Name: admin Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: method: > Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: exception: Flavor 42 could not be found. Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: action_args: {'id': '42'} Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:04:59.329911 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:04:59.330952 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.332470 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-3e51b007-f6a3-481f-9749-70c86bd6f587 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103505) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:04:59.333864 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-3e51b007-f6a3-481f-9749-70c86bd6f587 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.446510 Jul 24 01:04:59.333864 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Sun Jul 24 01:04:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:59.340093 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-bbafeed4-2ccd-4710-ac06-11cc8f93b604 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:59.343144 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:59.362332 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-bbafeed4-2ccd-4710-ac06-11cc8f93b604 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025880 Jul 24 01:04:59.362877 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Jul 24 01:04:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:04:59.372766 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-1677b71d-6c8a-485b-84fc-b1e48a9f8f32 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:59.393874 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-1677b71d-6c8a-485b-84fc-b1e48a9f8f32 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024634 Jul 24 01:04:59.394389 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Jul 24 01:04:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:04:59.407915 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-624af4f6-0f1c-443b-9593-7f8e65269ce7 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:04:59.417483 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.wsgi [None req-624af4f6-0f1c-443b-9593-7f8e65269ce7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-624af4f6-0f1c-443b-9593-7f8e65269ce7 admin admin] Request method failure captured: Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: Accept: application/json Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: Accept-Encoding: gzip, deflate Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: Connection: keep-alive Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: Content-Length: 0 Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: Host: 10.222.0.42 Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: Openstack-Api-Version: compute 2.90 Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: Openstack-System-Scope: None Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: User-Agent: python-novaclient Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Auth-Token: gAAAAABi3Jq66dGI-DuwTuo020pFFOK2zXOK-9L5XoljcikpHou1Vz9eRjbEV-eqeUwIDzCb8K6byYumABG8yQ6PcZrbj92s37r63bnvjnJ2ylBv7ypX_KcubU2SmjWThdJLzD75VpI5AqaMC01ljSoH4sSkq47Hi0ch0LnaEzXRPjTr--0KsVM Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Domain-Id: None Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Domain-Name: None Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Identity-Status: Confirmed Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Is-Admin-Project: True Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Domain-Id: default Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Domain-Name: Default Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Name: admin Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Role: admin,reader,member Jul 24 01:04:59.422769 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Roles: admin,reader,member Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05a6eda2714c497da6528545bd5b3ebc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}] Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Tenant: admin Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Tenant-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Tenant-Name: admin Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User: admin Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Domain-Id: default Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Domain-Name: Default Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Id: bd7e825180504b9cb4f914bcf260106f Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Name: admin Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: method: > Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: exception: Flavor 42 could not be found. Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: action_args: {'id': '42'} Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:04:59.424266 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:04:59.425103 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:04:59.426228 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-624af4f6-0f1c-443b-9593-7f8e65269ce7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:04:59.427394 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-624af4f6-0f1c-443b-9593-7f8e65269ce7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.023523 Jul 24 01:04:59.427394 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Sun Jul 24 01:04:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:00.401270 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-1677b71d-6c8a-485b-84fc-b1e48a9f8f32 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:00.402289 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-1677b71d-6c8a-485b-84fc-b1e48a9f8f32 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 24 01:05:00.402689 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:05:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:05:00.956154 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-97cfdcbf-7159-4876-9f79-5ba5c8e2695e admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:00.961774 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.wsgi [None req-97cfdcbf-7159-4876-9f79-5ba5c8e2695e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-97cfdcbf-7159-4876-9f79-5ba5c8e2695e admin admin] Request method failure captured: Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: Accept: application/json Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: Accept-Encoding: gzip, deflate Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: Connection: keep-alive Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: Content-Length: 0 Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: Host: 10.222.0.42 Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: Openstack-Api-Version: compute 2.90 Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: Openstack-System-Scope: None Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: User-Agent: python-novaclient Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Auth-Token: gAAAAABi3Jq8NdmaCrAzoHyDKJRVsfAU6rul8teli-LnO6o026HUxd1J1wkrx-u04CPkZnbno18JVM9A9FpWw-ta8ArITPOgFjgPzGQkclGX1RSXW8t_dmex5fWLZAwogKJLDpsIwOPyYG12MWP4lbKsjdv9j2y8kLJP2Wvn0o0_nbdJYXaHMxk Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Domain-Id: None Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Domain-Name: None Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Identity-Status: Confirmed Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Is-Admin-Project: True Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Domain-Id: default Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Domain-Name: Default Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Name: admin Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Role: admin,reader,member Jul 24 01:05:00.963323 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Roles: admin,reader,member Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05a6eda2714c497da6528545bd5b3ebc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}] Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Tenant: admin Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Tenant-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Tenant-Name: admin Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User: admin Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Domain-Id: default Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Domain-Name: Default Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Id: bd7e825180504b9cb4f914bcf260106f Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Name: admin Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: method: > Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: exception: Flavor 84 could not be found. Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: action_args: {'id': '84'} Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:05:00.964803 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:05:00.965759 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:00.967163 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-97cfdcbf-7159-4876-9f79-5ba5c8e2695e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:05:00.968427 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-97cfdcbf-7159-4876-9f79-5ba5c8e2695e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.427921 Jul 24 01:05:00.968427 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Sun Jul 24 01:05:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:00.974629 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-32c41dcb-86e4-4e66-90af-bd659e32fb21 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:00.988532 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-32c41dcb-86e4-4e66-90af-bd659e32fb21 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017608 Jul 24 01:05:00.989031 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Jul 24 01:05:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:05:00.998254 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-4e3c73ce-8941-407b-a53f-78972042ac05 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:01.011831 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-4e3c73ce-8941-407b-a53f-78972042ac05 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016987 Jul 24 01:05:01.012343 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Jul 24 01:05:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:05:01.021365 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-c5f72cc1-0792-41d8-b018-2734977da482 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:01.026968 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.wsgi [None req-c5f72cc1-0792-41d8-b018-2734977da482 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-c5f72cc1-0792-41d8-b018-2734977da482 admin admin] Request method failure captured: Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: Accept: application/json Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: Accept-Encoding: gzip, deflate Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: Connection: keep-alive Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: Content-Length: 0 Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: Host: 10.222.0.42 Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: Openstack-Api-Version: compute 2.90 Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: Openstack-System-Scope: None Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: User-Agent: python-novaclient Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Auth-Token: gAAAAABi3Jq8NdmaCrAzoHyDKJRVsfAU6rul8teli-LnO6o026HUxd1J1wkrx-u04CPkZnbno18JVM9A9FpWw-ta8ArITPOgFjgPzGQkclGX1RSXW8t_dmex5fWLZAwogKJLDpsIwOPyYG12MWP4lbKsjdv9j2y8kLJP2Wvn0o0_nbdJYXaHMxk Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Domain-Id: None Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Domain-Name: None Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Identity-Status: Confirmed Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Is-Admin-Project: True Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Domain-Id: default Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Domain-Name: Default Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Name: admin Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Role: admin,reader,member Jul 24 01:05:01.028524 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Roles: admin,reader,member Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05a6eda2714c497da6528545bd5b3ebc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}] Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Tenant: admin Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Tenant-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Tenant-Name: admin Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User: admin Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Domain-Id: default Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Domain-Name: Default Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Id: bd7e825180504b9cb4f914bcf260106f Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Name: admin Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: method: > Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: exception: Flavor 84 could not be found. Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: action_args: {'id': '84'} Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:05:01.030022 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:05:01.030955 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:01.032261 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-c5f72cc1-0792-41d8-b018-2734977da482 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103505) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:05:01.033462 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-c5f72cc1-0792-41d8-b018-2734977da482 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011928 Jul 24 01:05:01.033776 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Sun Jul 24 01:05:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:02.003235 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-4e3c73ce-8941-407b-a53f-78972042ac05 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:02.004332 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-4e3c73ce-8941-407b-a53f-78972042ac05 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 24 01:05:02.004737 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:05:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:05:02.568081 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-9233ebba-fe6b-48d0-a30a-c40c9d4fc407 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:02.574081 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.wsgi [None req-9233ebba-fe6b-48d0-a30a-c40c9d4fc407 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-9233ebba-fe6b-48d0-a30a-c40c9d4fc407 admin admin] Request method failure captured: Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: Accept: application/json Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: Accept-Encoding: gzip, deflate Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: Connection: keep-alive Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: Content-Length: 0 Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: Host: 10.222.0.42 Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: Openstack-Api-Version: compute 2.90 Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: Openstack-System-Scope: None Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: User-Agent: python-novaclient Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Auth-Token: gAAAAABi3Jq9t51-skJL5wRSPVpIxGAKy5QoQ9Hl9AaHNMAFHjoiY4NQm2mVbVdcthxZl6sfh7ixOIfmt-VHU10hNVSG-0xIzo2p4y6zAo8mYtm34ftXLz9GN3lsLv-dnOhv1F3KDavYANnlgopX-tbHWgRnKA17rZk9xVvpiqS9qo76uo-IWlw Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Domain-Id: None Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Domain-Name: None Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Identity-Status: Confirmed Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Is-Admin-Project: True Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Domain-Id: default Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Domain-Name: Default Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Project-Name: admin Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Role: admin,reader,member Jul 24 01:05:02.575620 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Roles: admin,reader,member Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05a6eda2714c497da6528545bd5b3ebc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}] Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Tenant: admin Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Tenant-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-Tenant-Name: admin Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User: admin Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Domain-Id: default Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Domain-Name: Default Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Id: bd7e825180504b9cb4f914bcf260106f Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: X-User-Name: admin Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: method: > Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: exception: Flavor 451 could not be found. Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: action_args: {'id': '451'} Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:05:02.577288 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:05:02.578266 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.579792 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-9233ebba-fe6b-48d0-a30a-c40c9d4fc407 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103505) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:05:02.581160 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-9233ebba-fe6b-48d0-a30a-c40c9d4fc407 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.423839 Jul 24 01:05:02.581160 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Jul 24 01:05:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:02.587170 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-da1d6f47-29f5-41e8-a48c-92c90f787f35 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:02.601251 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-da1d6f47-29f5-41e8-a48c-92c90f787f35 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017825 Jul 24 01:05:02.601781 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Jul 24 01:05:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:05:02.611444 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:02.626439 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018546 Jul 24 01:05:02.626951 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Sun Jul 24 01:05:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:05:02.636467 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-1e26fb2e-0e07-4ed0-814a-f035b3f90cc4 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:02.642164 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.wsgi [None req-1e26fb2e-0e07-4ed0-814a-f035b3f90cc4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-1e26fb2e-0e07-4ed0-814a-f035b3f90cc4 admin admin] Request method failure captured: Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: Accept: application/json Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: Accept-Encoding: gzip, deflate Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: Connection: keep-alive Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: Content-Length: 0 Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: Host: 10.222.0.42 Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: Openstack-Api-Version: compute 2.90 Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: Openstack-System-Scope: None Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: User-Agent: python-novaclient Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Auth-Token: gAAAAABi3Jq9t51-skJL5wRSPVpIxGAKy5QoQ9Hl9AaHNMAFHjoiY4NQm2mVbVdcthxZl6sfh7ixOIfmt-VHU10hNVSG-0xIzo2p4y6zAo8mYtm34ftXLz9GN3lsLv-dnOhv1F3KDavYANnlgopX-tbHWgRnKA17rZk9xVvpiqS9qo76uo-IWlw Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Domain-Id: None Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Domain-Name: None Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Identity-Status: Confirmed Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Is-Admin-Project: True Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Domain-Id: default Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Domain-Name: Default Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Project-Name: admin Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Role: admin,reader,member Jul 24 01:05:02.643714 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Roles: admin,reader,member Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05a6eda2714c497da6528545bd5b3ebc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05a6eda2714c497da6528545bd5b3ebc"}]}] Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Tenant: admin Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Tenant-Id: 05a6eda2714c497da6528545bd5b3ebc Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-Tenant-Name: admin Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User: admin Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Domain-Id: default Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Domain-Name: Default Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Id: bd7e825180504b9cb4f914bcf260106f Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: X-User-Name: admin Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: method: > Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: exception: Flavor 451 could not be found. Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: action_args: {'id': '451'} Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:05:02.645463 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:05:02.646396 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: ERROR nova.api.openstack.wsgi Jul 24 01:05:02.647582 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-1e26fb2e-0e07-4ed0-814a-f035b3f90cc4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:05:02.648686 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-1e26fb2e-0e07-4ed0-814a-f035b3f90cc4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012142 Jul 24 01:05:02.648686 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Jul 24 01:05:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:03.620490 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:03.621492 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 24 01:05:03.621879 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:05:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:05:04.172162 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-68667216-2417-4f1d-bac2-8b38cf5cea7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:05:04.193638 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-68667216-2417-4f1d-bac2-8b38cf5cea7c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.435979 Jul 24 01:05:04.194423 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Sun Jul 24 01:05:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:05:05.190246 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:05.191254 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 24 01:05:05.191685 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:05:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:05:05.751383 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-27c1fe32-3ec4-40e4-a369-1d3a8712eedb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:05:05.772630 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-27c1fe32-3ec4-40e4-a369-1d3a8712eedb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.445260 Jul 24 01:05:05.773340 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Sun Jul 24 01:05:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:05:06.747312 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:06.748351 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 24 01:05:06.748745 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:05:07.316378 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-baca775b-9319-4782-aaac-1afd2bb1d8f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:05:07.343582 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-baca775b-9319-4782-aaac-1afd2bb1d8f6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.456569 Jul 24 01:05:07.344403 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Sun Jul 24 01:05:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:05:08.346831 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:08.347880 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 24 01:05:08.348276 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:05:08.919239 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-c53acc1f-e88c-4ebf-bd53-dc962162f834 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:05:08.942247 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-c53acc1f-e88c-4ebf-bd53-dc962162f834 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.457540 Jul 24 01:05:08.942800 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Sun Jul 24 01:05:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:05:09.924017 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:09.925269 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001921 Jul 24 01:05:09.925802 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:05:10.495691 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-e4873a8c-4909-4246-956d-d4c7b43c01b5 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:05:10.515594 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-e4873a8c-4909-4246-956d-d4c7b43c01b5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.450874 Jul 24 01:05:10.516114 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Sun Jul 24 01:05:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:06:02.628974 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:02.630253 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-b2c1fb1a-c84c-44b0-b87a-7a03d90c88f2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 Jul 24 01:06:02.630790 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Sun Jul 24 01:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:06:02.647412 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:03.050989 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-cf080985-9462-470d-bd3f-0e6f29a2d42f admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:03.071527 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-cf080985-9462-470d-bd3f-0e6f29a2d42f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.431161 Jul 24 01:06:03.072004 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Sun Jul 24 01:06:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:06:03.092710 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG dbcounter [-] [103505] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:03.096947 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-718fe389-4495-4871-819f-c6c4fe7ea8e8 admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:03.105606 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-718fe389-4495-4871-819f-c6c4fe7ea8e8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014346 Jul 24 01:06:03.106132 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Sun Jul 24 01:06:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:06:03.118028 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-b02a7cb1-2f3b-473e-9f68-964621d5d3ba admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:03.125761 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-b02a7cb1-2f3b-473e-9f68-964621d5d3ba admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011343 Jul 24 01:06:03.126273 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Sun Jul 24 01:06:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:06:03.138177 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:03.146578 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012223 Jul 24 01:06:03.147092 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Sun Jul 24 01:06:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:06:03.164373 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-ae41cb4a-4bff-48b7-b56a-e8428ad3b592 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:03.175153 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-ae41cb4a-4bff-48b7-b56a-e8428ad3b592 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016294 Jul 24 01:06:03.175706 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Sun Jul 24 01:06:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:30.090107 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:30.091116 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 24 01:09:30.091548 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:30.232843 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_api:SELECT=6 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:30.420051 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-1a6249d1-aebc-41f2-9034-f1a1d3dd11bc admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:30.421875 dv-cinder-master-3-smb devstack@n-api.service[103504]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:30.421875 dv-cinder-master-3-smb devstack@n-api.service[103504]: warnings.warn(msg) Jul 24 01:09:30.423597 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-1a6249d1-aebc-41f2-9034-f1a1d3dd11bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:30.424299 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-1a6249d1-aebc-41f2-9034-f1a1d3dd11bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:30.425523 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-1a6249d1-aebc-41f2-9034-f1a1d3dd11bc admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:30.426142 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-1a6249d1-aebc-41f2-9034-f1a1d3dd11bc admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:30.464909 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-1a6249d1-aebc-41f2-9034-f1a1d3dd11bc admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.234612 Jul 24 01:09:30.465429 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:30 2022] GET /compute/v2.1/os-services => generated 785 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:09:31.288009 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:31.289285 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001999 Jul 24 01:09:31.289787 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:31.492395 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-4d8b15c3-f960-484a-a15f-d5366a5d99be admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:31.493505 dv-cinder-master-3-smb devstack@n-api.service[103504]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:31.493505 dv-cinder-master-3-smb devstack@n-api.service[103504]: warnings.warn(msg) Jul 24 01:09:31.494685 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-4d8b15c3-f960-484a-a15f-d5366a5d99be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:31.495120 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-4d8b15c3-f960-484a-a15f-d5366a5d99be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:31.495947 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-4d8b15c3-f960-484a-a15f-d5366a5d99be admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:31.496368 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-4d8b15c3-f960-484a-a15f-d5366a5d99be admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:31.515931 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-4d8b15c3-f960-484a-a15f-d5366a5d99be admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.088575 Jul 24 01:09:31.516478 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:31 2022] GET /compute/v2.1/os-services => generated 785 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:09:42.777271 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:42.778276 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jul 24 01:09:42.778667 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:09:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:42.920193 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_cell0:SELECT=4 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:42.920910 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_cell1:SELECT=4 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:42.921519 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG dbcounter [-] [103504] Writing DB stats nova_api:SELECT=8 {{(pid=103504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:42.972666 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-9af9b4ca-8abe-484c-b216-0e0bbd34aedd admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:42.973791 dv-cinder-master-3-smb devstack@n-api.service[103504]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:42.973791 dv-cinder-master-3-smb devstack@n-api.service[103504]: warnings.warn(msg) Jul 24 01:09:42.974990 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-9af9b4ca-8abe-484c-b216-0e0bbd34aedd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:42.975549 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-9af9b4ca-8abe-484c-b216-0e0bbd34aedd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:42.976313 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-9af9b4ca-8abe-484c-b216-0e0bbd34aedd admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:42.976795 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-9af9b4ca-8abe-484c-b216-0e0bbd34aedd admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:43.008929 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-9af9b4ca-8abe-484c-b216-0e0bbd34aedd admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.093184 Jul 24 01:09:43.009486 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:42 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:09:43.847326 dv-cinder-master-3-smb devstack@n-api.service[103505]: DEBUG nova.api.openstack.wsgi [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] Calling method '>' {{(pid=103505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:43.848342 dv-cinder-master-3-smb devstack@n-api.service[103505]: INFO nova.api.openstack.requestlog [None req-2eae338e-1147-40b2-ad0f-b1322eac60cf admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 24 01:09:43.848731 dv-cinder-master-3-smb devstack@n-api.service[103505]: [pid: 103505|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Sun Jul 24 01:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:44.040363 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG nova.api.openstack.wsgi [None req-2462680f-2de2-4e86-b2af-2b021ededb36 admin admin] Calling method '>' {{(pid=103504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:44.041552 dv-cinder-master-3-smb devstack@n-api.service[103504]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:44.041552 dv-cinder-master-3-smb devstack@n-api.service[103504]: warnings.warn(msg) Jul 24 01:09:44.042802 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-2462680f-2de2-4e86-b2af-2b021ededb36 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:44.043234 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-2462680f-2de2-4e86-b2af-2b021ededb36 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:44.044086 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-2462680f-2de2-4e86-b2af-2b021ededb36 admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:44.044565 dv-cinder-master-3-smb devstack@n-api.service[103504]: DEBUG oslo_concurrency.lockutils [None req-2462680f-2de2-4e86-b2af-2b021ededb36 admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:44.066687 dv-cinder-master-3-smb devstack@n-api.service[103504]: INFO nova.api.openstack.requestlog [None req-2462680f-2de2-4e86-b2af-2b021ededb36 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.081336 Jul 24 01:09:44.067144 dv-cinder-master-3-smb devstack@n-api.service[103504]: [pid: 103504|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:43 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:10:50.760774 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Jul 24 01:10:50.761343 dv-cinder-master-3-smb devstack@n-api.service[103503]: Sun Jul 24 01:10:50 2022 - graceful shutdown triggered... Jul 24 01:10:50.761789 dv-cinder-master-3-smb devstack@n-api.service[103505]: Gracefully killing worker 2 (pid: 103505)... Jul 24 01:10:50.762141 dv-cinder-master-3-smb devstack@n-api.service[103504]: Gracefully killing worker 1 (pid: 103504)... Jul 24 01:10:51.762630 dv-cinder-master-3-smb devstack@n-api.service[103503]: worker 1 buried after 1 seconds Jul 24 01:10:51.762630 dv-cinder-master-3-smb devstack@n-api.service[103503]: worker 2 buried after 1 seconds Jul 24 01:10:51.762630 dv-cinder-master-3-smb devstack@n-api.service[103503]: goodbye to uWSGI. Jul 24 01:10:51.765142 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Jul 24 01:10:51.766029 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Jul 24 01:10:51.770443 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Jul 24 01:10:51.785926 dv-cinder-master-3-smb devstack@n-api.service[118011]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 24 01:10:51 2022] *** Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: nodename: dv-cinder-master-3-smb Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: machine: x86_64 Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: clock source: unix Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: pcre jit disabled Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: detected number of CPU cores: 4 Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: current working directory: / Jul 24 01:10:51.788780 dv-cinder-master-3-smb devstack@n-api.service[118011]: detected binary path: /usr/bin/uwsgi-core Jul 24 01:10:51.789450 dv-cinder-master-3-smb devstack@n-api.service[118011]: your processes number limit is 47680 Jul 24 01:10:51.789450 dv-cinder-master-3-smb devstack@n-api.service[118011]: your memory page size is 4096 bytes Jul 24 01:10:51.789450 dv-cinder-master-3-smb devstack@n-api.service[118011]: detected max file descriptor number: 2048 Jul 24 01:10:51.789450 dv-cinder-master-3-smb devstack@n-api.service[118011]: lock engine: pthread robust mutexes Jul 24 01:10:51.789450 dv-cinder-master-3-smb devstack@n-api.service[118011]: thunder lock: enabled Jul 24 01:10:51.789450 dv-cinder-master-3-smb devstack@n-api.service[118011]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 24 01:10:51.789450 dv-cinder-master-3-smb devstack@n-api.service[118011]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 24 01:10:51.834930 dv-cinder-master-3-smb devstack@n-api.service[118011]: Python main interpreter initialized at 0x55619582c9c0 Jul 24 01:10:51.834930 dv-cinder-master-3-smb devstack@n-api.service[118011]: python threads support enabled Jul 24 01:10:51.834930 dv-cinder-master-3-smb devstack@n-api.service[118011]: your server socket listen backlog is limited to 100 connections Jul 24 01:10:51.834930 dv-cinder-master-3-smb devstack@n-api.service[118011]: your mercy for graceful operations on workers is 90 seconds Jul 24 01:10:51.835425 dv-cinder-master-3-smb devstack@n-api.service[118011]: mapped 403077 bytes (393 KB) for 2 cores Jul 24 01:10:51.835425 dv-cinder-master-3-smb devstack@n-api.service[118011]: *** Operational MODE: preforking *** Jul 24 01:10:51.835689 dv-cinder-master-3-smb devstack@n-api.service[118011]: *** uWSGI is running in multiple interpreter mode *** Jul 24 01:10:51.835689 dv-cinder-master-3-smb devstack@n-api.service[118011]: spawned uWSGI master process (pid: 118011) Jul 24 01:10:51.835909 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Jul 24 01:10:51.836609 dv-cinder-master-3-smb devstack@n-api.service[118011]: spawned uWSGI worker 1 (pid: 118035, cores: 1) Jul 24 01:10:51.836835 dv-cinder-master-3-smb devstack@n-api.service[118011]: spawned uWSGI worker 2 (pid: 118036, cores: 1) Jul 24 01:10:51.837001 dv-cinder-master-3-smb devstack@n-api.service[118011]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 24 01:10:52.489306 dv-cinder-master-3-smb devstack@n-api.service[118035]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 24 01:10:52.489962 dv-cinder-master-3-smb devstack@n-api.service[118036]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 24 01:10:53.665425 dv-cinder-master-3-smb devstack@n-api.service[118035]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:10:53.665425 dv-cinder-master-3-smb devstack@n-api.service[118035]: from cryptography.utils import int_from_bytes Jul 24 01:10:53.666147 dv-cinder-master-3-smb devstack@n-api.service[118035]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:10:53.666147 dv-cinder-master-3-smb devstack@n-api.service[118035]: from cryptography.utils import int_from_bytes Jul 24 01:10:53.667879 dv-cinder-master-3-smb devstack@n-api.service[118036]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:10:53.667879 dv-cinder-master-3-smb devstack@n-api.service[118036]: from cryptography.utils import int_from_bytes Jul 24 01:10:53.668391 dv-cinder-master-3-smb devstack@n-api.service[118036]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:10:53.668391 dv-cinder-master-3-smb devstack@n-api.service[118036]: from cryptography.utils import int_from_bytes Jul 24 01:10:55.924198 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 01:10:55.925010 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 01:10:55.925550 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 01:10:55.925922 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 01:10:55.926144 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 01:10:55.926570 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.926902 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.927227 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.927576 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.927970 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.928255 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.928368 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 01:10:55.928743 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.928831 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 01:10:55.928924 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.929130 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 01:10:55.929239 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.929461 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.929597 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 01:10:55.930095 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 01:10:55.930180 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.930451 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.930562 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.930781 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.930889 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.931095 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.931263 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.931480 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.931654 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.931804 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.932017 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.932165 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.932318 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.932470 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.932621 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.932765 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.932919 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.933069 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.933218 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.933396 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.933541 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.933815 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.934132 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.934588 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.934796 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.935018 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.935231 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.935471 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.935679 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.935887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.936101 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.936330 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.936330 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.936747 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.936747 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.937154 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.937381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.937600 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.937817 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.938032 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.938294 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.938500 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.938725 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.938944 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.939170 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.939392 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.939642 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.939826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.940010 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.940202 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.940350 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.940511 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.940511 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.940834 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.940989 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.941355 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.941355 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.942707 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.942707 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.943023 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.943182 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.943348 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.943557 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.943708 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.943708 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.944013 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.944205 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.944367 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.944516 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.944660 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.944814 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.944971 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.945126 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.945126 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.945561 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.946611 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.946774 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.946935 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.947088 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.947232 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.947424 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.947571 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.947571 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.947876 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.948028 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.948177 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.948327 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.948496 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.948652 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.948806 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.948806 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.949642 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.949642 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.949937 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.950095 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.950251 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.950402 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.950570 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.950724 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.950888 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.951203 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.951460 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.951929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.952083 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.952250 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.952403 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.952597 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.952907 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.953061 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.953211 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.953355 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.953507 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.953663 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.953807 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.953957 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.954108 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.954279 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.954431 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.954582 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.954732 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.954882 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.955023 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.955175 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.955356 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.955587 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.955736 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.955736 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.956195 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.956371 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.956515 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.956667 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.956810 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.956953 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.957103 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.957265 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.957409 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.957558 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.957702 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.957849 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.958003 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.958152 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.958313 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.958502 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.958659 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.958802 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.958960 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.959104 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.959259 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.959447 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.959591 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.959743 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.959896 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.960047 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.960189 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.960341 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.960492 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.960635 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.960790 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.960933 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.961077 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.961348 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.961519 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.961678 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.962116 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.962116 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.962407 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.962563 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.962742 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.963189 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.963372 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.963372 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.963669 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.963820 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.963970 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.964127 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.964272 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.964414 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.964557 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.964698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.964860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.965012 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.965166 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.965321 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.965463 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.965689 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.965838 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.966184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.966346 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.966499 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.966643 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.966793 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.966946 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.967149 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.967373 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.967525 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.967679 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.967828 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.967989 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.968133 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.968282 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.968434 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.968576 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.968726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.968869 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.969010 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.969170 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.969321 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.969464 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.969611 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.969760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.969902 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.970044 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.970194 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.970344 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.970494 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.970645 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.970788 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.970929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.971087 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.971230 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.971396 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.971554 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.971697 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.971838 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.972258 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.972409 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.972568 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.972722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.974010 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.974165 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.974337 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.974491 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.974643 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.974875 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.975022 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.975181 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.975346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.975496 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.975639 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.975890 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.976042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.976293 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.976442 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.976598 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.976742 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.976885 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.977028 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.977185 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.977330 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.977474 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.977622 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.977765 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.977915 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.978067 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.978219 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.978363 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.978519 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.978519 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.978805 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.978958 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.979112 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.979263 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.979434 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.979589 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.979750 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.979901 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.980050 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.980201 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.980363 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.980507 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:10:55.980663 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.980807 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.980950 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.981091 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.981234 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.981389 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.981533 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.981683 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.981825 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.981968 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.982440 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.982607 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.982752 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.982905 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.983057 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.983454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.983727 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.983896 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.984049 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.984201 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.984351 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.984736 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.984894 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.985070 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.985235 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.985380 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.985530 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.985673 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.986049 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.986218 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.986466 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.986622 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.986764 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.986862 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.986957 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987050 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987148 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987243 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987399 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987491 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987578 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987677 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987772 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987859 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.987944 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988036 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988231 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988319 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988411 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988498 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988584 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988684 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988786 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988873 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.988969 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989064 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989152 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989246 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989344 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989440 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989535 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989621 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989712 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989810 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989905 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.989992 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990086 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990171 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990256 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990350 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990445 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990445 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990613 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990705 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990791 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.990957 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991054 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991141 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991225 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991325 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991602 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991702 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991802 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991895 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.991991 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.992093 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.992205 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.992475 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.992575 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.992662 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.992764 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.992866 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.992961 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.993056 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.993157 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.993157 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.993358 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.993455 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.993558 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.993645 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.993901 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994055 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994190 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994291 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994385 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994470 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994564 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994660 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994747 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994849 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.994937 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995030 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995123 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995222 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995345 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995433 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995518 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995602 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995707 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995805 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995892 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.995991 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.996090 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.996191 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.996286 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.996381 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.996618 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.996714 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.996808 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.996902 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997002 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997089 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997193 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997287 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997382 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997468 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997562 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997649 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997734 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.997924 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998018 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998113 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998200 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998331 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998421 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998516 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998603 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998702 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998789 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998873 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.998973 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999060 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999159 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999254 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999362 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999463 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999552 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999652 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999754 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999849 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:55.999944 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000038 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000125 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000217 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000321 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000409 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000493 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000578 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000663 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000755 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000850 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.000939 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001029 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001115 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001200 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001299 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001387 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001473 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001565 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001651 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001738 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001832 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.001925 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.002025 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.002113 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.002224 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.002310 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.002401 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.002772 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.002862 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.002957 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.003051 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.003145 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.003247 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.003415 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.003547 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.003640 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.003640 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.003820 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.003820 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004149 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004149 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004297 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004297 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004475 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004569 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004663 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004749 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004833 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.004918 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005016 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005103 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005199 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005292 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005377 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005470 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005570 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005668 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005756 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005848 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.005934 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.006086 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.006184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.006275 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.006366 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.006452 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.006565 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.006745 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.006867 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.007054 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.007160 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.007391 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.007505 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.007701 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.007796 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.008025 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.008118 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.008326 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.008429 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.008639 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.008733 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.008952 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.009042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.009264 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.009366 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.009579 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.009682 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.009892 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.009985 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.010195 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.010297 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.010514 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.010612 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.010820 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.010913 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.011128 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.011429 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.011536 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.011611 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.011766 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.011871 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.012073 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.013099 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.013257 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.013257 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.013471 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.013592 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.013703 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.013829 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.013951 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.014720 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.014853 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.014974 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.015096 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.015219 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.015367 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.015367 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.015605 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.015717 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.015842 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.015955 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.016072 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.016072 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.016285 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.016405 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.016530 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.016651 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.016786 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.016975 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.017090 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.017200 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.017323 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.017436 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.017545 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.017663 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.017774 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.017892 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.018013 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.018141 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.018263 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.018382 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.018492 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.018624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.018743 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.018860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.018971 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.019091 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.019200 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.019352 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.019481 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.019601 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.019736 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.019825 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.019918 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.020127 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.020221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.020425 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.020525 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.020733 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.020839 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.021050 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.021152 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.021357 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.021556 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.021684 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.021846 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.021989 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.022082 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.022290 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.022386 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.022589 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.022699 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.022909 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.023033 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.023220 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.023356 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.023545 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.023732 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.023843 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.023939 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.024562 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.024683 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.024683 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.024871 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.024958 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.025032 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.025032 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.025179 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.025375 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.025491 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.025671 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.025770 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.025977 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.026078 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.026285 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.026380 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.026598 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.026698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.026903 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.027008 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.027215 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.027340 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.027545 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.027639 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.027851 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.027945 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.028160 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.028253 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.028466 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.028558 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.028768 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.028876 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.029070 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.029169 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.029449 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.029582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.029684 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.029968 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.030063 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.030273 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.030372 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.030574 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.030668 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.030880 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.030974 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.031195 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.031288 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.031571 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.031782 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.031886 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.032116 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.032217 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.032436 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.032565 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.032758 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.032870 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.033079 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.033201 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.033403 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.033509 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.033719 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.033812 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.034031 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.034213 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.034338 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.034430 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.034642 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.034749 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.034944 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.035036 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.035247 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.035407 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.035575 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.035679 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.035879 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.036049 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.036180 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.036272 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.036483 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.036591 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.036782 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.036875 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.037087 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.037205 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.037437 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.037532 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.037740 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.037841 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.038042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.038141 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.038346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.038449 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.038658 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.038761 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.038961 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.039059 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.039267 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.039419 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.039605 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.039731 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.039912 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.040020 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.040217 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.040342 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.040519 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.040678 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.040820 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.041023 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.041118 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.041331 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.041447 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.041636 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.041757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.041961 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.042090 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.042268 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.042412 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.042573 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.042751 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.042877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.043057 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.043213 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.043390 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.043501 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.043712 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.043806 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.044014 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.044115 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.044314 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.044407 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.044614 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.044708 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.044920 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.045013 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.045227 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.045319 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.045525 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.045618 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.045834 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.045925 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.046139 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.046233 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.046446 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.046550 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.046746 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.046839 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.047044 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.047371 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.047673 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.047844 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.047999 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.048166 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.048317 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.048486 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.048637 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.048796 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.048954 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.049106 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.049255 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.049419 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.049578 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.049749 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.049985 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.050144 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.050307 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.050468 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.050619 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.050722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.050958 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.051273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.051606 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.051782 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.051911 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.052155 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.052283 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.052608 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.052756 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.052911 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.053040 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.053178 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.053411 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.053554 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.053718 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.053858 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.054030 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.054172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.054354 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.054546 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.055905 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.056050 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.056189 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.056327 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.056460 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.056603 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.056745 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.056883 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.057013 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.057013 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.057240 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.057369 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.057500 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.057629 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.057757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.057886 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.058015 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.058153 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.058292 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.058425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.058555 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.058693 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.058823 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.058974 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.059105 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.059234 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.059381 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.059525 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.059679 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.059811 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.059964 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.060174 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.060311 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.060432 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.060570 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.060713 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.060713 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.060968 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.061098 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.061337 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.061486 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.061625 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.061757 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.061886 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.062016 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.062209 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.062390 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.062532 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.062668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.062805 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.062934 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.063114 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.063392 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.063528 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.063669 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.063810 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.063938 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.064077 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.064207 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.064335 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.064462 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.064654 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.064787 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.064967 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.065101 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.065280 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.065412 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.065600 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.065742 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.065966 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.066116 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.066247 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.066375 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.066536 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.066668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.066846 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.066981 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.067156 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.067289 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.067491 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.067636 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.067802 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.067944 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.068112 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.068244 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.068445 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.068616 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.068814 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.068955 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.069129 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.069270 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.069441 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.069594 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.069755 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.069896 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.070063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.070288 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.070421 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.070562 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.070693 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.070968 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.071112 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.071308 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.071458 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.071624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.071756 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.071928 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.072072 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.072238 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.072385 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.072543 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.072684 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.072857 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.072999 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.073163 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.073306 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.073496 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.073635 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.073809 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.074368 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.074507 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.074653 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.074793 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.074923 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.075052 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.075190 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.075404 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.075548 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.075686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.075817 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.075947 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.076077 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.076210 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.076340 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.076484 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.076623 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.076761 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.076899 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.077042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.077182 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.077320 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.077581 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.077885 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.078036 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.078190 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.078343 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.078489 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.078678 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.078842 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.078998 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.079150 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.079326 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.079478 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.079624 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.079767 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.079935 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.080088 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.080240 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.080478 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.080637 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.080782 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.081068 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.081224 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.081369 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.081513 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.081669 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.081812 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.081987 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.082133 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.082277 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.082420 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.082563 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.082720 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.082865 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.083015 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.083166 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.083321 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.083509 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.083655 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.083817 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.083952 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.084160 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.084309 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.084487 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.084653 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.084800 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.084952 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.085105 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.085258 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.085402 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.085662 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.085815 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.086013 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.086190 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.086429 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.086611 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.086768 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.086915 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.087058 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.087201 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.087397 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.087550 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.087702 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.087859 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.088007 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.088176 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.088321 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.088472 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.088623 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.088765 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.088915 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.089072 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.089215 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.089358 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.089507 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.089652 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.089795 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.089950 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.090115 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.090337 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.090509 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.090658 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.090799 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.090953 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.091099 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.091378 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.091542 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.091688 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.091845 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.091992 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.092136 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.092291 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.092435 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.092593 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.092751 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.092898 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.093049 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.093194 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.093345 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.093498 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.093657 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.093801 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.093951 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.094103 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.094258 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.094864 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.095030 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.095184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.095409 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.095563 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.095707 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.095868 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.096014 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.096157 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.096380 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.096529 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.096674 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.096843 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.096988 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.097131 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.097283 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.097283 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.097565 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.097722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.097867 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.098028 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.098179 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.098330 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.098475 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.098647 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.098791 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.098934 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.099084 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.099236 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.099421 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.099568 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.099791 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.099959 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.100112 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.100264 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.100418 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.100572 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.100726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.100871 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.101015 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.101168 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.101339 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.101582 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.101741 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.101893 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.102045 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.102198 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.102351 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.102506 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.102660 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.102816 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.102960 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.103118 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.103271 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.103512 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.103658 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.103817 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.103971 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.104125 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.104125 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.104398 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.104550 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.104714 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.104859 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.105018 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.105169 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.105314 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.105465 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.105608 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.105760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.105917 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.106062 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.106213 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.106357 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.106501 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.106665 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.106810 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.106969 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.107113 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.107257 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.107425 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.107582 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.107727 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.107877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.108030 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.108181 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.108324 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.108477 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.108639 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.108784 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.108926 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.109075 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.109218 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.109371 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.109522 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.109674 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.109826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.109979 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.110133 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.110277 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.110420 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.110573 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.110724 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.110724 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.111008 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.111160 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.111333 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.111486 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.111742 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.111909 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.112072 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.112217 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.112369 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.112532 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.112677 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.112830 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.113013 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.113164 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.113310 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.113454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.113606 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.113765 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.113917 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.114061 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.114205 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.114357 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.114515 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.114742 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.114889 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.115033 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.115184 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.115375 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.115534 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.115689 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.115833 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.115984 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.116137 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.116282 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.116446 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.116591 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.116735 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.116887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.117042 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.117042 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.117337 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.117491 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.117636 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.117779 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.117936 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.118084 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.118251 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.118396 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.118549 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.118701 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.118845 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.118998 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.119149 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.119335 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.119500 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.119646 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.119796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.119950 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.120104 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.120259 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.120411 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.120556 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.120709 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.120867 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.121020 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.121165 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.121308 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.121452 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.121452 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.121758 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.121998 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.122159 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.122312 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.122464 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.122624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.122769 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.122769 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.123058 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.123210 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.123398 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.123551 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.123702 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.123860 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.124032 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.124184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.124341 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.124485 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.124629 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.124773 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.124929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.125079 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.125238 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.125389 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.125541 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.125541 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.125847 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.126000 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.126153 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.126305 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.126468 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.126660 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.126660 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.127180 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.127492 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.127654 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.127801 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.127944 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.128097 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.128271 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.128418 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.128561 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.128706 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.128855 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.129000 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.129153 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.129297 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.129440 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.129583 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.129726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.129880 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.130043 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.130197 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.130348 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.130491 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.130634 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.130786 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.130953 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.131130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.131276 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.131443 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.131599 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.131753 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.131905 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.132173 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.132173 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.132454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.132599 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.132757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.132910 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.133065 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.133218 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.133362 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.133522 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.133668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.133820 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.133972 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.134128 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.134279 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.134432 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.134586 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.134731 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.134884 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.135030 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.135181 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.135361 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.135520 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.135672 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.135814 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.135969 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.135969 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.136937 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.137103 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.137257 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.137402 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.137591 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.137751 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.137904 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.138049 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.138216 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.138373 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.138519 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.138688 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.138834 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.138977 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.139129 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.139274 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.139477 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.139637 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.139782 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.139933 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.140077 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.140229 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.140376 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.140529 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.140692 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.140844 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.140997 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.141140 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.141293 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.141439 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.141582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.141733 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.141886 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.142037 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.142190 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.142349 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.142501 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.142670 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.142826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.142826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.143220 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.143386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.143545 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.143691 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.143841 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.143985 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.144216 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.144363 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.144363 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.144644 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.144810 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.144973 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.145118 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.145264 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.145408 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.145553 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.145705 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.145858 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.146002 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.146145 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.146298 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.146450 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.146697 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.146863 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.147030 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.147187 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.147389 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.147542 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.147698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.147853 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.147853 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.148143 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.148304 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.148448 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.148607 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.148774 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.148919 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.149063 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.149214 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.149357 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.149523 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.149668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.149819 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.149963 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.150116 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.150261 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.150414 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.150569 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.150713 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.150713 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.150986 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.151143 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.151143 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.151442 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.151597 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.151796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.151954 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.152109 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.152252 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.152395 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.152548 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.152691 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.152835 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.152988 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.153249 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.153410 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.153556 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.153702 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.153853 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.154212 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.154372 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.154524 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.154524 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.154826 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.154984 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.155130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.155130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.155477 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.155624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.155767 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.155926 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.156072 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.156223 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.156366 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.156509 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.156662 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.156816 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.156968 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.157114 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.157264 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.157416 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.157569 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.157714 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.157858 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.157858 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.158130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.158130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.158446 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.158591 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.158734 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.158876 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.159019 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.159176 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.159349 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.159511 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.159656 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.159807 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.159950 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.160103 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.160256 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.160411 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.160555 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.160699 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.160849 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.161003 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.161172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.161401 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.161590 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.161781 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.161961 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.162156 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.162424 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.162627 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.162808 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.162989 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.163179 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.163509 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.163663 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.163820 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.163964 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.164119 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.164273 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.164426 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.164571 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.164722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.164722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.165024 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.165184 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.165335 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.165335 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.165335 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.165335 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.165876 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.166027 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.166173 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.166316 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.166466 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.166621 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.166780 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.166925 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.167076 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.167227 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.167405 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.167552 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.167712 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.167864 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.168016 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.168174 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.168324 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.168468 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.169115 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.169270 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.169415 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.169569 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.169715 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.169864 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.170024 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.170175 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.170326 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.170475 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.170625 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.170795 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.170955 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.171117 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.171276 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.171475 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.171636 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.171802 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.171955 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.172111 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.172262 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.172419 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.172578 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.172738 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.172890 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.173051 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.173201 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.173351 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.173586 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.173747 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.173905 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.174063 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.174729 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.174899 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.175062 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.175221 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.175427 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.175591 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.175758 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.175911 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.176079 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.176231 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.176390 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.176541 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.176541 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.176541 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.176978 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.177131 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.177281 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.177433 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.177582 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.177750 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.177956 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.178126 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.178282 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.178433 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.178584 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.178752 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.178912 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.179071 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.179223 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.179429 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.179583 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.180121 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.180269 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.180413 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.180563 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.180757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.180916 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.181069 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.181215 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.181358 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.181358 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.181641 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.181797 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.181953 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.182096 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.182239 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.182390 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.182534 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.182691 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.182850 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.183008 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.183160 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.183336 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.183495 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.183658 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.183809 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.183972 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.184123 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.184272 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.184437 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.184596 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.184766 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.185051 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.185216 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 01:10:56.185386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.185386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.185386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.185386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.185386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.185386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.185386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.185386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.186598 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.186598 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.186598 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.186598 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.186598 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.186598 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.187582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.187582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.187582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.188024 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.188197 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.188429 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:10:56.188674 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 01:10:56.342693 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO dbcounter [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Registered counter for database nova_api Jul 24 01:10:56.354500 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO dbcounter [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Registered counter for database nova_api Jul 24 01:10:56.364666 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_db.sqlalchemy.engines [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118035) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:10:56.372293 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writer thread running {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:10:56.376506 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_db.sqlalchemy.engines [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:10:56.383469 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writer thread running {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:10:56.428413 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.context [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0485860-44f6-4783-97a7-f4dbef82a919(cell1) {{(pid=118035) load_cells /opt/stack/nova/nova/context.py:464}} Jul 24 01:10:56.432925 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:56.434541 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:56.435402 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:56.437396 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:56.439447 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO dbcounter [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Registered counter for database nova_cell0 Jul 24 01:10:56.440288 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.context [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0485860-44f6-4783-97a7-f4dbef82a919(cell1) {{(pid=118036) load_cells /opt/stack/nova/nova/context.py:464}} Jul 24 01:10:56.443588 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO dbcounter [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Registered counter for database nova_cell1 Jul 24 01:10:56.444390 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:56.446035 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:56.446852 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:56.448842 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:56.450930 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO dbcounter [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Registered counter for database nova_cell0 Jul 24 01:10:56.451111 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_db.sqlalchemy.engines [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118035) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:10:56.452874 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_db.sqlalchemy.engines [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118035) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:10:56.455139 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO dbcounter [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Registered counter for database nova_cell1 Jul 24 01:10:56.459289 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writer thread running {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:10:56.460664 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writer thread running {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:10:56.464021 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_db.sqlalchemy.engines [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:10:56.464787 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_db.sqlalchemy.engines [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:10:56.471890 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writer thread running {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:10:56.473170 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writer thread running {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:10:56.604166 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO dbcounter [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Registered counter for database nova_cell0 Jul 24 01:10:56.611512 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_db.sqlalchemy.engines [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118035) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:10:56.616175 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writer thread running {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:10:56.619434 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO dbcounter [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Registered counter for database nova_cell0 Jul 24 01:10:56.626343 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_db.sqlalchemy.engines [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:10:56.630973 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writer thread running {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:10:56.927089 dv-cinder-master-3-smb devstack@n-api.service[118035]: WARNING keystonemiddleware.auth_token [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:10:56.934811 dv-cinder-master-3-smb devstack@n-api.service[118035]: WARNING keystonemiddleware.auth_token [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:10:56.947252 dv-cinder-master-3-smb devstack@n-api.service[118036]: WARNING keystonemiddleware.auth_token [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:10:56.954503 dv-cinder-master-3-smb devstack@n-api.service[118036]: WARNING keystonemiddleware.auth_token [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:10:57.277654 dv-cinder-master-3-smb devstack@n-api.service[118035]: WARNING keystonemiddleware.auth_token [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:10:57.283760 dv-cinder-master-3-smb devstack@n-api.service[118035]: WARNING keystonemiddleware.auth_token [None req-d7b80b53-b310-4f69-af00-fa89444d27fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:10:57.290071 dv-cinder-master-3-smb devstack@n-api.service[118035]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55619582c9c0 pid: 118035 (default app) Jul 24 01:10:57.297335 dv-cinder-master-3-smb devstack@n-api.service[118036]: WARNING keystonemiddleware.auth_token [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:10:57.303696 dv-cinder-master-3-smb devstack@n-api.service[118036]: WARNING keystonemiddleware.auth_token [None req-bfc3cce0-03a6-478c-966c-dd646510a41b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:10:57.310304 dv-cinder-master-3-smb devstack@n-api.service[118036]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55619582c9c0 pid: 118036 (default app) Jul 24 01:11:38.931850 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=3 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:38.932717 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=3 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:38.933712 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=3 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:38.934679 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=3 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:40.257736 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-833a80c5-acbd-41f9-98f4-dd630f6f2d56 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Action: 'create', calling method: .version_select at 0x7fdf3e200d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1857000287"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:40.834165 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:40.835650 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:40.836563 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:40.840262 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:41.148732 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0d95cd2f-919b-47b2-8c10-803de615a657 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3e1df790>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:41.530977 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-833a80c5-acbd-41f9-98f4-dd630f6f2d56 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.616263 Jul 24 01:11:41.534298 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1154 bytes} [Sun Jul 24 01:11:38 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2621 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 24 01:11:41.546676 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ce033926-8b13-42e8-b202-36e06b94f58d tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3e05cb80>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:41.648250 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ce033926-8b13-42e8-b202-36e06b94f58d tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5" status: 200 len: 345 microversion: 2.1 time: 0.103253 Jul 24 01:11:41.649462 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:11:41 2022] GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:41.841658 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0d95cd2f-919b-47b2-8c10-803de615a657 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e8ef6e2e-13ad-41fc-8217-01d5ac96d114" status: 200 len: 350 microversion: 2.1 time: 1.012924 Jul 24 01:11:41.843196 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 1/3] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:11:40 2022] GET /compute/v2.1/os-volumes/e8ef6e2e-13ad-41fc-8217-01d5ac96d114 => generated 350 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:42.665051 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-518af834-5fd3-4390-a646-63101d03ef10 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3e05cdc0>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:42.896373 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-518af834-5fd3-4390-a646-63101d03ef10 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5" status: 200 len: 346 microversion: 2.1 time: 0.238383 Jul 24 01:11:42.897305 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:11:42 2022] GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 => generated 346 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:42.914646 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-98a960bf-b8f9-4943-a391-3a3263c61bf6 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Action: 'create', calling method: .version_select at 0x7fdf3e0a0a60>, body: {"snapshot": {"volume_id": "3816d010-b476-48e3-bf42-5ada3bfb92b5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1766540020"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:43.401534 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-98a960bf-b8f9-4943-a391-3a3263c61bf6 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.495534 Jul 24 01:11:43.402648 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 2/5] 10.222.0.42 () {60 vars in 1161 bytes} [Sun Jul 24 01:11:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:43.412854 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-59aded7f-ef88-4de9-ab1c-34bde4f31336 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3e074310>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:43.490885 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-59aded7f-ef88-4de9-ab1c-34bde4f31336 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c" status: 200 len: 287 microversion: 2.1 time: 0.081793 Jul 24 01:11:43.491772 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 4/6] 10.222.0.42 () {58 vars in 1250 bytes} [Sun Jul 24 01:11:43 2022] GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:43.503188 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-38fd89b4-5999-497b-8bdf-000b5a811942 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3e0a0ee0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:43.568397 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-38fd89b4-5999-497b-8bdf-000b5a811942 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.069740 Jul 24 01:11:43.569604 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 3/7] 10.222.0.42 () {58 vars in 1139 bytes} [Sun Jul 24 01:11:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:43.580401 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b2438a48-d6a7-47f8-bafd-c72bfecf9ca5 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3e074a60>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:43.632507 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b2438a48-d6a7-47f8-bafd-c72bfecf9ca5 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c" status: 200 len: 287 microversion: 2.1 time: 0.056089 Jul 24 01:11:43.633086 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1250 bytes} [Sun Jul 24 01:11:43 2022] GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:43.798754 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-30f9dd6a-2ce4-4ba5-8062-c3dde4e61673 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3e06a790>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:43.908946 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-30f9dd6a-2ce4-4ba5-8062-c3dde4e61673 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/06abfeaf-015e-4689-9498-d0ccfab05914" status: 200 len: 351 microversion: 2.1 time: 0.115225 Jul 24 01:11:43.909760 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 4/9] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:11:43 2022] GET /compute/v2.1/os-volumes/06abfeaf-015e-4689-9498-d0ccfab05914 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:44.645960 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5c2c9c47-a4ae-44c2-8738-5f3bed309d1f tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3e074ca0>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:44.736755 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5c2c9c47-a4ae-44c2-8738-5f3bed309d1f tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c" status: 200 len: 288 microversion: 2.1 time: 0.095910 Jul 24 01:11:44.737959 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 6/10] 10.222.0.42 () {58 vars in 1250 bytes} [Sun Jul 24 01:11:44 2022] GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c => generated 288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:44.760822 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a7d6880e-5903-4c2c-bf27-54fbb5f465a2 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3e06aee0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:44.909977 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a7d6880e-5903-4c2c-bf27-54fbb5f465a2 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c" status: 202 len: 0 microversion: 2.1 time: 0.165906 Jul 24 01:11:44.910939 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 5/11] 10.222.0.42 () {58 vars in 1253 bytes} [Sun Jul 24 01:11:44 2022] DELETE /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:44.919624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0efa802f-8876-4287-be86-366e693481dc tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3e0744c0>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:44.982851 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0efa802f-8876-4287-be86-366e693481dc tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c" status: 200 len: 287 microversion: 2.1 time: 0.067504 Jul 24 01:11:44.985031 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1250 bytes} [Sun Jul 24 01:11:44 2022] GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:45.710637 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5d4cb501-2490-43bf-8fbb-574d6b5f87c8 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3e06a8b0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:45.826751 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5d4cb501-2490-43bf-8fbb-574d6b5f87c8 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4217e9ae-38e3-48b4-809f-12fb192ba383" status: 200 len: 351 microversion: 2.1 time: 0.120900 Jul 24 01:11:45.832223 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 6/13] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:11:45 2022] GET /compute/v2.1/os-volumes/4217e9ae-38e3-48b4-809f-12fb192ba383 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:45.859141 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7ca119c5-210c-4c6f-832e-8f83bd673934 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3e05c940>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:45.996385 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-04fb3951-2b02-45a7-9dd4-cb9f9592a082 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3e06a160>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:46.010735 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7ca119c5-210c-4c6f-832e-8f83bd673934 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.166793 Jul 24 01:11:46.011326 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 8/14] 10.222.0.42 () {58 vars in 1133 bytes} [Sun Jul 24 01:11:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:46.023505 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b8025ec8-37fe-49f5-a249-8fe3e6d3d862 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3e05cca0>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:46.041024 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-04fb3951-2b02-45a7-9dd4-cb9f9592a082 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] HTTP exception thrown: Snapshot 7704968d-2bab-4b3f-8335-621fd4a5a73c could not be found. Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-04fb3951-2b02-45a7-9dd4-cb9f9592a082 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Request method failure captured: Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c HTTP/1.1 Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxKED_OsgWgjXfzosL0RuarAD1FuOxUzv8v9rvWEMiVOxwAMBEKBBJbepfwyra-4Tc2qPZYZZbvVQP87JdeX9n863sCJUNnqz1-6R-k2MsnR58xuJclk5gfVhojvuGlbsPZfyaBd7O-Z-cyswbo24HyOE8FR_VU7g7sSePw5iLGcWo Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 39d60a6aa0c045f9b27fb65b647772c6 Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:11:46.045444 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/39d60a6aa0c045f9b27fb65b647772c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_39d60a6aa0c045f9b27fb65b647772c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/39d60a6aa0c045f9b27fb65b647772c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/39d60a6aa0c045f9b27fb65b647772c6"}]}] Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 39d60a6aa0c045f9b27fb65b647772c6 Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesSnapshotsTestJSON-186294848-project Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 930defb348d1476c8021deb4ebfa590a Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesSnapshotsTestJSON-186294848-project Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Snapshot 7704968d-2bab-4b3f-8335-621fd4a5a73c could not be found. Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '7704968d-2bab-4b3f-8335-621fd4a5a73c'} Jul 24 01:11:46.046822 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7704968d-2bab-4b3f-8335-621fd4a5a73c could not be found. (HTTP 404) (Request-ID: req-7dae41dc-0aa8-4232-9922-aa73596843e8) Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:46.047607 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:11:46.048452 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7704968d-2bab-4b3f-8335-621fd4a5a73c could not be found. Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 24 01:11:46.049315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7704968d-2bab-4b3f-8335-621fd4a5a73c could not be found. Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7704968d-2bab-4b3f-8335-621fd4a5a73c could not be found. Jul 24 01:11:46.050253 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:46.055760 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-04fb3951-2b02-45a7-9dd4-cb9f9592a082 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Returning 404 to user: Snapshot 7704968d-2bab-4b3f-8335-621fd4a5a73c could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:46.059098 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-04fb3951-2b02-45a7-9dd4-cb9f9592a082 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c" status: 404 len: 111 microversion: 2.1 time: 0.066556 Jul 24 01:11:46.065899 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1250 bytes} [Sun Jul 24 01:11:45 2022] GET /compute/v2.1/os-snapshots/7704968d-2bab-4b3f-8335-621fd4a5a73c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:11:46.071415 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-78e4ea88-cb95-43ff-8bdb-d2b011e8161b tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3dfd3550>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:46.196901 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-78e4ea88-cb95-43ff-8bdb-d2b011e8161b tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5" status: 202 len: 0 microversion: 2.1 time: 0.129470 Jul 24 01:11:46.197438 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:11:46 2022] DELETE /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:46.206725 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1e5c8444-607c-4c48-beaa-48b20d50dac2 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3dfd3ca0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:46.224379 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b8025ec8-37fe-49f5-a249-8fe3e6d3d862 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.204553 Jul 24 01:11:46.225082 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 9/17] 10.222.0.42 () {58 vars in 1148 bytes} [Sun Jul 24 01:11:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:46.237259 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0698e096-726e-41f7-b8c9-00fc20cd1be2 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3e074790>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:46.322026 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1e5c8444-607c-4c48-beaa-48b20d50dac2 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5" status: 200 len: 345 microversion: 2.1 time: 0.117807 Jul 24 01:11:46.324744 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 9/18] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:11:46 2022] GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:46.480832 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0698e096-726e-41f7-b8c9-00fc20cd1be2 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.247262 Jul 24 01:11:46.481605 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 10/19] 10.222.0.42 () {58 vars in 1133 bytes} [Sun Jul 24 01:11:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:46.494553 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c6148cd1-2b62-4319-8b9e-de1d4be01b07 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3dfd8310>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:46.735393 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c6148cd1-2b62-4319-8b9e-de1d4be01b07 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.246202 Jul 24 01:11:46.742880 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 10/20] 10.222.0.42 () {58 vars in 1166 bytes} [Sun Jul 24 01:11:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:46.749554 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7bac460e-ce1c-4013-a0ff-9d459f4fcf94 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3e081670>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.016121 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7bac460e-ce1c-4013-a0ff-9d459f4fcf94 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.271443 Jul 24 01:11:47.018593 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 11/21] 10.222.0.42 () {58 vars in 1169 bytes} [Sun Jul 24 01:11:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:47.032736 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8c77361a-b76f-4d9d-8071-abd1b81b1eac tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3dfd3c10>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.207012 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8c77361a-b76f-4d9d-8071-abd1b81b1eac tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.179729 Jul 24 01:11:47.207852 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 11/22] 10.222.0.42 () {58 vars in 1154 bytes} [Sun Jul 24 01:11:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:47.221450 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7b675013-467d-4f5d-9bb0-b8b4f90be953 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3e081dc0>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.338494 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-34ffd2ec-9584-4b22-abbd-28e1a34c6b0b tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3dfd8040>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.401357 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-34ffd2ec-9584-4b22-abbd-28e1a34c6b0b tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] HTTP exception thrown: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-34ffd2ec-9584-4b22-abbd-28e1a34c6b0b tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Request method failure captured: Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 HTTP/1.1 Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxKED_OsgWgjXfzosL0RuarAD1FuOxUzv8v9rvWEMiVOxwAMBEKBBJbepfwyra-4Tc2qPZYZZbvVQP87JdeX9n863sCJUNnqz1-6R-k2MsnR58xuJclk5gfVhojvuGlbsPZfyaBd7O-Z-cyswbo24HyOE8FR_VU7g7sSePw5iLGcWo Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 39d60a6aa0c045f9b27fb65b647772c6 Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:11:47.404155 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/39d60a6aa0c045f9b27fb65b647772c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_39d60a6aa0c045f9b27fb65b647772c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/39d60a6aa0c045f9b27fb65b647772c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/39d60a6aa0c045f9b27fb65b647772c6"}]}] Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 39d60a6aa0c045f9b27fb65b647772c6 Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesSnapshotsTestJSON-186294848-project Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 930defb348d1476c8021deb4ebfa590a Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesSnapshotsTestJSON-186294848-project Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '3816d010-b476-48e3-bf42-5ada3bfb92b5'} Jul 24 01:11:47.405504 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. (HTTP 404) (Request-ID: req-829c914d-7a90-4543-bce0-8a41a37eaecf) Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:47.406338 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:11:47.407546 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 24 01:11:47.408683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.409798 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.415024 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7b675013-467d-4f5d-9bb0-b8b4f90be953 tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.199072 Jul 24 01:11:47.416158 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1187 bytes} [Sun Jul 24 01:11:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:47.417882 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-34ffd2ec-9584-4b22-abbd-28e1a34c6b0b tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Returning 404 to user: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:47.418927 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-34ffd2ec-9584-4b22-abbd-28e1a34c6b0b tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5" status: 404 len: 109 microversion: 2.1 time: 0.085701 Jul 24 01:11:47.419703 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 12/24] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:11:47 2022] GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:11:47.440547 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-72e6e936-c30b-4d75-a1d2-385cfe2e56dc tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] Calling method '.version_select at 0x7fdf3e074c10>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.446040 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8ac94b9b-66ba-4e82-abbe-9ee7f72fd623 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3dfd8ee0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.495794 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-8ac94b9b-66ba-4e82-abbe-9ee7f72fd623 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] HTTP exception thrown: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8ac94b9b-66ba-4e82-abbe-9ee7f72fd623 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Request method failure captured: Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: DELETE /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 HTTP/1.1 Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxKED_OsgWgjXfzosL0RuarAD1FuOxUzv8v9rvWEMiVOxwAMBEKBBJbepfwyra-4Tc2qPZYZZbvVQP87JdeX9n863sCJUNnqz1-6R-k2MsnR58xuJclk5gfVhojvuGlbsPZfyaBd7O-Z-cyswbo24HyOE8FR_VU7g7sSePw5iLGcWo Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 39d60a6aa0c045f9b27fb65b647772c6 Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:11:47.498779 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/39d60a6aa0c045f9b27fb65b647772c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_39d60a6aa0c045f9b27fb65b647772c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/39d60a6aa0c045f9b27fb65b647772c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/39d60a6aa0c045f9b27fb65b647772c6"}]}] Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 39d60a6aa0c045f9b27fb65b647772c6 Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesSnapshotsTestJSON-186294848-project Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 930defb348d1476c8021deb4ebfa590a Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesSnapshotsTestJSON-186294848-project Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '3816d010-b476-48e3-bf42-5ada3bfb92b5'} Jul 24 01:11:47.500113 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. (HTTP 404) (Request-ID: req-6e4ed829-aeed-463d-816a-34c57180c79f) Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:47.500972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:11:47.502078 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 24 01:11:47.502987 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8ac94b9b-66ba-4e82-abbe-9ee7f72fd623 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Returning 404 to user: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8ac94b9b-66ba-4e82-abbe-9ee7f72fd623 tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5" status: 404 len: 109 microversion: 2.1 time: 0.064607 Jul 24 01:11:47.503972 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:11:47 2022] DELETE /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:11:47.510023 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5b9bb1d5-bdda-4547-9307-4a38d191772c tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Calling method '.version_select at 0x7fdf3dfe6790>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.552767 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-5b9bb1d5-bdda-4547-9307-4a38d191772c tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] HTTP exception thrown: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5b9bb1d5-bdda-4547-9307-4a38d191772c tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Request method failure captured: Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 HTTP/1.1 Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxKED_OsgWgjXfzosL0RuarAD1FuOxUzv8v9rvWEMiVOxwAMBEKBBJbepfwyra-4Tc2qPZYZZbvVQP87JdeX9n863sCJUNnqz1-6R-k2MsnR58xuJclk5gfVhojvuGlbsPZfyaBd7O-Z-cyswbo24HyOE8FR_VU7g7sSePw5iLGcWo Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 39d60a6aa0c045f9b27fb65b647772c6 Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:11:47.557120 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/39d60a6aa0c045f9b27fb65b647772c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_39d60a6aa0c045f9b27fb65b647772c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/39d60a6aa0c045f9b27fb65b647772c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/39d60a6aa0c045f9b27fb65b647772c6"}]}] Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 39d60a6aa0c045f9b27fb65b647772c6 Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-186294848 Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesSnapshotsTestJSON-186294848-project Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 930defb348d1476c8021deb4ebfa590a Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesSnapshotsTestJSON-186294848-project Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '3816d010-b476-48e3-bf42-5ada3bfb92b5'} Jul 24 01:11:47.558322 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. (HTTP 404) (Request-ID: req-6d43f2e1-e1fd-417f-a85a-b2c4f05bc0c0) Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:47.558967 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:11:47.559976 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 24 01:11:47.561336 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. Jul 24 01:11:47.562239 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:11:47.563922 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5b9bb1d5-bdda-4547-9307-4a38d191772c tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] Returning 404 to user: Volume 3816d010-b476-48e3-bf42-5ada3bfb92b5 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:47.564958 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5b9bb1d5-bdda-4547-9307-4a38d191772c tempest-VolumesSnapshotsTestJSON-186294848 tempest-VolumesSnapshotsTestJSON-186294848-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5" status: 404 len: 109 microversion: 2.1 time: 0.058669 Jul 24 01:11:47.566243 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 14/26] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:11:47 2022] GET /compute/v2.1/os-volumes/3816d010-b476-48e3-bf42-5ada3bfb92b5 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:11:47.631391 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-72e6e936-c30b-4d75-a1d2-385cfe2e56dc tempest-VolumesTestJSON-101023426 tempest-VolumesTestJSON-101023426-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.202504 Jul 24 01:11:47.632138 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1154 bytes} [Sun Jul 24 01:11:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:55.214837 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e75dfc0e-5ae5-449a-a0f3-c3ce874a0dc5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: .version_select at 0x7fdf3dfd8820>, body: {"keypair": {"name": "tempest-keypair-484873425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP92nHhbnzpxay7vJmVGaBO366NHSMFuicX7BmbW7wVMkmf72c/5hnQOKdlGMWIDupEaZ3dk+Bj6RyHyNIjd7J0eMJPCSfggHdJPoXNck0ZtFdgoT06yOia2cww5KK7LrQ=="}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:55.363862 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-e75dfc0e-5ae5-449a-a0f3-c3ce874a0dc5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:11:55.376984 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-e75dfc0e-5ae5-449a-a0f3-c3ce874a0dc5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for user 1e7d0f401530454ba0cae0f5e9d6e0ce and project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:11:55.455625 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e75dfc0e-5ae5-449a-a0f3-c3ce874a0dc5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.720745 Jul 24 01:11:55.456250 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 15/28] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Jul 24 01:11:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:55.775566 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1905466878", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "networks": [{"uuid": "9149eb30-950a-4b8c-9043-66d7f6d639c7"}]}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:55.987365 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7053587e-2472-4358-893c-5a1747023a28 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'create', calling method: .version_select at 0x7fdf3dfb81f0>, body: {"keypair": {"name": "tempest-keypair-1648629464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5zlXtfEaa69+RKJhOuq7XTFXAeYxFEtwcHAXm9hMpmqdXCTwWVESoyb9+LSFYE+tKv3ng0Cm4FQRkFhLSXfyYQ9+hbcYoLLzdNi2XpBe+JkNsvWRuhiULqofU2wTnsdA=="}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:55.992698 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.network.neutron [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] validate_networks() for [('9149eb30-950a-4b8c-9043-66d7f6d639c7', None, None, None, None, None)] {{(pid=118035) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:11:56.032737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-7053587e-2472-4358-893c-5a1747023a28 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Getting quotas for project cc1d39abfaef4e9c80564f545f431bbe. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:11:56.042133 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-7053587e-2472-4358-893c-5a1747023a28 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Getting quotas for user 601f4db65bf74587ab9b0080a44b4f79 and project cc1d39abfaef4e9c80564f545f431bbe. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:11:56.092300 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7053587e-2472-4358-893c-5a1747023a28 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.630481 Jul 24 01:11:56.100744 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 16/29] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Jul 24 01:11:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:56.599046 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-890515810", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:56.841161 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] validate_networks() for [('c20a7dfc-f709-4537-b8c6-5da500bdb8c8', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:11:59.762317 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Flavor limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:11:59.762770 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Image limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:11:59.763207 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Flavor pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:11:59.763675 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Image pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:11:59.764224 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:11:59.798824 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:59.803643 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:59.804895 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:59.805338 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:59.923184 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Getting quotas for project e076ee7a9aba4327977e47cd15f4d598. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:11:59.937244 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Getting quotas for user 2d7d2c987db04aaabc0d75c1930f9c6f and project e076ee7a9aba4327977e47cd15f4d598. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:11:59.960064 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Going to run 1 instances... {{(pid=118035) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:11:59.968321 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118035) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:12:00.334851 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d3d3a738-ab14-4077-abcb-87dc55c6777d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.331361 Jul 24 01:12:00.340190 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 14/30] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 5338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:12:00.369344 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f1224b82-6c4f-4f2b-bc62-9cfc25550f88 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:00.370379 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f1224b82-6c4f-4f2b-bc62-9cfc25550f88 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:00.620553 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f1224b82-6c4f-4f2b-bc62-9cfc25550f88 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:00.644223 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:12:00.644771 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:12:00.645171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:12:00.645669 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:12:00.646280 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:12:00.661044 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:00.661654 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:00.662503 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:00.662990 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:00.669518 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f1224b82-6c4f-4f2b-bc62-9cfc25550f88 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1215 microversion: 2.1 time: 0.320490 Jul 24 01:12:00.681723 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 15/31] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:00 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1215 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:00.720592 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Getting quotas for project 55d33269082642989cbc18c052f07b94. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:00.729469 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Getting quotas for user 1b8154ce6b6b40b4959bf354ccb5c59d and project 55d33269082642989cbc18c052f07b94. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:00.752811 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:12:00.756002 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:12:00.904926 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e7ce274f-8509-437f-9a77-411672bff82e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.439159 Jul 24 01:12:00.906133 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 17/32] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:11:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 4441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:12:00.916378 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-95be264a-fc3f-4f23-a8b0-0d2efc047a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:00.916994 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-95be264a-fc3f-4f23-a8b0-0d2efc047a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:01.138622 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1859616199", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cbf3785-1abb-4c73-84eb-0d42ef9e3194"}], "security_groups": [{"name": "tempest-securitygroup--1752819126"}], "key_name": "tempest-keypair-1648629464", "user_data": "}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:01.311857 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-95be264a-fc3f-4f23-a8b0-0d2efc047a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:01.355757 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-95be264a-fc3f-4f23-a8b0-0d2efc047a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1221 microversion: 2.1 time: 0.440823 Jul 24 01:12:01.372585 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 16/33] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:00 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1221 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:01.574054 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] validate_networks() for [('2cbf3785-1abb-4c73-84eb-0d42ef9e3194', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:12:01.709955 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-09f45cb0-320f-4ac3-b305-43d319459948 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:01.710948 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-09f45cb0-320f-4ac3-b305-43d319459948 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:01.869497 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-09f45cb0-320f-4ac3-b305-43d319459948 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:01.886306 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-09f45cb0-320f-4ac3-b305-43d319459948 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1215 microversion: 2.1 time: 0.192260 Jul 24 01:12:01.895600 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 17/34] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:01 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:02.089002 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2098288796", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:02.197952 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.network.neutron [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] validate_networks() for [('c20a7dfc-f709-4537-b8c6-5da500bdb8c8', None, None, None, None, None)] {{(pid=118035) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:12:03.412623 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:12:03.413140 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:12:03.413629 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:12:03.414411 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:12:03.414962 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:12:03.442480 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:03.442942 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:03.443766 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:03.444209 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:03.531506 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Getting quotas for project cc1d39abfaef4e9c80564f545f431bbe. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:03.548817 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Getting quotas for user 601f4db65bf74587ab9b0080a44b4f79 and project cc1d39abfaef4e9c80564f545f431bbe. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:03.645069 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:12:03.647840 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:12:03.806417 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-bca52487-ec84-4bad-9798-d1c824e6da12 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.673220 Jul 24 01:12:03.807896 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 18/35] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:12:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:12:03.829532 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c7f72d07-60ee-45c1-82bf-4e5ffd0f0507 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:03.833026 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c7f72d07-60ee-45c1-82bf-4e5ffd0f0507 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:03.893655 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7f72d07-60ee-45c1-82bf-4e5ffd0f0507 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:03.894677 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7f72d07-60ee-45c1-82bf-4e5ffd0f0507 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:03.896316 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7f72d07-60ee-45c1-82bf-4e5ffd0f0507 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:03.897135 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7f72d07-60ee-45c1-82bf-4e5ffd0f0507 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:04.228384 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c7f72d07-60ee-45c1-82bf-4e5ffd0f0507 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:04.273124 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c7f72d07-60ee-45c1-82bf-4e5ffd0f0507 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1267 microversion: 2.1 time: 0.461427 Jul 24 01:12:04.276888 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 19/36] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:03 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1267 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:04.277906 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Flavor limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:12:04.278877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Image limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:12:04.279551 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Flavor pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:12:04.280130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Image pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:12:04.280909 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:12:04.294561 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1843364397", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcbaf71d-4a65-44d0-a781-ad7ed5a13863"}], "security_groups": [{"name": "tempest-securitygroup--1612540698"}], "key_name": "tempest-keypair-484873425", "user_data": "}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:04.350038 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:04.350486 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:04.351282 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:04.363505 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:04.455971 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Getting quotas for project 55d33269082642989cbc18c052f07b94. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:04.473586 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Getting quotas for user 1b8154ce6b6b40b4959bf354ccb5c59d and project 55d33269082642989cbc18c052f07b94. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:04.520930 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Going to run 1 instances... {{(pid=118035) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:12:04.524482 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118035) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:12:04.551335 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] validate_networks() for [('fcbaf71d-4a65-44d0-a781-ad7ed5a13863', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:12:04.757698 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-602f8c1d-53f8-4d7d-923c-c6dc38d9a318 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.671467 Jul 24 01:12:04.767981 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:12:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:12:04.790849 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2c67ce9c-e2e8-4fa4-bb5a-7966dc327653 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:04.791435 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-2c67ce9c-e2e8-4fa4-bb5a-7966dc327653 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:05.322030 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2c67ce9c-e2e8-4fa4-bb5a-7966dc327653 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:05.330806 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2c67ce9c-e2e8-4fa4-bb5a-7966dc327653 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1238 microversion: 2.1 time: 0.560975 Jul 24 01:12:05.333549 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 19/38] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:04 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1238 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:05.354655 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f47fae2e-7368-4a34-bc49-dcc5c3f0929e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:05.357880 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f47fae2e-7368-4a34-bc49-dcc5c3f0929e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:06.323667 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f47fae2e-7368-4a34-bc49-dcc5c3f0929e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:06.349556 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f47fae2e-7368-4a34-bc49-dcc5c3f0929e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1222 microversion: 2.1 time: 1.012836 Jul 24 01:12:06.354020 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 20/39] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:05 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1222 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:06.384684 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-41dc0369-40d3-4d79-a72b-4b70790319d1 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:06.390858 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-41dc0369-40d3-4d79-a72b-4b70790319d1 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:06.426308 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-41dc0369-40d3-4d79-a72b-4b70790319d1 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:06.426577 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-41dc0369-40d3-4d79-a72b-4b70790319d1 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:06.436602 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-41dc0369-40d3-4d79-a72b-4b70790319d1 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:06.437090 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-41dc0369-40d3-4d79-a72b-4b70790319d1 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:07.172784 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:12:07.173934 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:12:07.175690 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:12:07.177635 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:12:07.178329 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:12:07.215582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:07.224318 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:07.229877 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:07.233454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:07.336248 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:07.361472 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for user 1e7d0f401530454ba0cae0f5e9d6e0ce and project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:07.419637 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:12:07.429625 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:12:07.530417 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-41dc0369-40d3-4d79-a72b-4b70790319d1 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:07.556130 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-41dc0369-40d3-4d79-a72b-4b70790319d1 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1273 microversion: 2.1 time: 1.199366 Jul 24 01:12:07.576096 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 21/40] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:06 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1273 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:07.598758 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9c345155-86c5-4a8f-8306-d2be3235c230 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:07.601692 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9c345155-86c5-4a8f-8306-d2be3235c230 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:07.631077 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9c345155-86c5-4a8f-8306-d2be3235c230 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:07.635092 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9c345155-86c5-4a8f-8306-d2be3235c230 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:07.636374 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9c345155-86c5-4a8f-8306-d2be3235c230 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:07.637453 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9c345155-86c5-4a8f-8306-d2be3235c230 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:07.643990 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-733b1841-8025-471a-a8c4-f414e7671762 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.365945 Jul 24 01:12:07.644815 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:12:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 3369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:12:07.660459 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4c122818-bd7d-4662-b123-11d545caab20 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:07.662942 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4c122818-bd7d-4662-b123-11d545caab20 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:07.699223 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c122818-bd7d-4662-b123-11d545caab20 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:07.706956 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c122818-bd7d-4662-b123-11d545caab20 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:07.709841 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c122818-bd7d-4662-b123-11d545caab20 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:07.727241 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c122818-bd7d-4662-b123-11d545caab20 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:08.612964 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4c122818-bd7d-4662-b123-11d545caab20 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:08.628573 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4c122818-bd7d-4662-b123-11d545caab20 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1292 microversion: 2.1 time: 0.980855 Jul 24 01:12:08.634830 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 21/42] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:07 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1292 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:08.662143 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-359edcb0-375c-4ad2-8291-b5b26d72d8eb tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:08.662784 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-359edcb0-375c-4ad2-8291-b5b26d72d8eb tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:08.761990 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-359edcb0-375c-4ad2-8291-b5b26d72d8eb tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:08.762473 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-359edcb0-375c-4ad2-8291-b5b26d72d8eb tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:08.763273 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-359edcb0-375c-4ad2-8291-b5b26d72d8eb tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:08.763741 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-359edcb0-375c-4ad2-8291-b5b26d72d8eb tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:09.069812 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9c345155-86c5-4a8f-8306-d2be3235c230 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:09.085967 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9c345155-86c5-4a8f-8306-d2be3235c230 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1296 microversion: 2.1 time: 1.506228 Jul 24 01:12:09.097600 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 22/43] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:07 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1296 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:09.120447 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-01d5ee63-97bc-4580-a5fd-823b981c20c5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:09.137384 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-01d5ee63-97bc-4580-a5fd-823b981c20c5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:09.163433 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-01d5ee63-97bc-4580-a5fd-823b981c20c5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:09.163888 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-01d5ee63-97bc-4580-a5fd-823b981c20c5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:09.179859 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-01d5ee63-97bc-4580-a5fd-823b981c20c5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:09.180324 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-01d5ee63-97bc-4580-a5fd-823b981c20c5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:09.336080 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-359edcb0-375c-4ad2-8291-b5b26d72d8eb tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:09.345225 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-359edcb0-375c-4ad2-8291-b5b26d72d8eb tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1245 microversion: 2.1 time: 0.706955 Jul 24 01:12:09.345815 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 22/44] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:08 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1245 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:09.656633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a347e509-ae88-4b49-9e51-5cb1f89245f4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:09.657311 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a347e509-ae88-4b49-9e51-5cb1f89245f4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:09.679166 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a347e509-ae88-4b49-9e51-5cb1f89245f4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:09.679781 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a347e509-ae88-4b49-9e51-5cb1f89245f4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:09.681127 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a347e509-ae88-4b49-9e51-5cb1f89245f4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:09.681579 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a347e509-ae88-4b49-9e51-5cb1f89245f4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:09.725538 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-01d5ee63-97bc-4580-a5fd-823b981c20c5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:09.744561 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-01d5ee63-97bc-4580-a5fd-823b981c20c5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1273 microversion: 2.1 time: 0.635110 Jul 24 01:12:09.749598 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 23/45] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:09 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1273 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:10.113950 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8186bd82-48ca-4ed4-b4ac-fe8f6b2d5c32 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:10.115375 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8186bd82-48ca-4ed4-b4ac-fe8f6b2d5c32 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:10.129489 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8186bd82-48ca-4ed4-b4ac-fe8f6b2d5c32 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.129982 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8186bd82-48ca-4ed4-b4ac-fe8f6b2d5c32 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.130825 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8186bd82-48ca-4ed4-b4ac-fe8f6b2d5c32 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.131324 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8186bd82-48ca-4ed4-b4ac-fe8f6b2d5c32 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.153449 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a347e509-ae88-4b49-9e51-5cb1f89245f4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:10.171441 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a347e509-ae88-4b49-9e51-5cb1f89245f4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1280 microversion: 2.1 time: 0.525030 Jul 24 01:12:10.172690 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 23/46] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:09 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1280 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:10.363735 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-968648ed-e560-4162-bfca-50b186c80213 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:10.366736 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-968648ed-e560-4162-bfca-50b186c80213 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:10.387888 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-968648ed-e560-4162-bfca-50b186c80213 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.389820 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-968648ed-e560-4162-bfca-50b186c80213 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.395080 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-968648ed-e560-4162-bfca-50b186c80213 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.396242 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-968648ed-e560-4162-bfca-50b186c80213 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.281731 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8186bd82-48ca-4ed4-b4ac-fe8f6b2d5c32 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:11.324350 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8186bd82-48ca-4ed4-b4ac-fe8f6b2d5c32 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1296 microversion: 2.1 time: 1.213822 Jul 24 01:12:11.331175 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 24/47] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:10 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1296 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:11.371914 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d109bcd5-277f-497a-a421-26620a226e97 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:11.378373 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d109bcd5-277f-497a-a421-26620a226e97 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:11.403113 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d109bcd5-277f-497a-a421-26620a226e97 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.407192 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d109bcd5-277f-497a-a421-26620a226e97 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.415728 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d109bcd5-277f-497a-a421-26620a226e97 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.417987 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d109bcd5-277f-497a-a421-26620a226e97 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.615061 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-968648ed-e560-4162-bfca-50b186c80213 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:11.628557 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-968648ed-e560-4162-bfca-50b186c80213 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1311 microversion: 2.1 time: 1.269681 Jul 24 01:12:11.630917 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:10 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1311 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:11.655080 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7eebe256-6c15-4add-8a81-8420763af1c0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:11.655940 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7eebe256-6c15-4add-8a81-8420763af1c0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:11.683444 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7eebe256-6c15-4add-8a81-8420763af1c0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.686493 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7eebe256-6c15-4add-8a81-8420763af1c0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.687697 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7eebe256-6c15-4add-8a81-8420763af1c0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.689018 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7eebe256-6c15-4add-8a81-8420763af1c0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.791065 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d109bcd5-277f-497a-a421-26620a226e97 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:11.803207 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d109bcd5-277f-497a-a421-26620a226e97 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1273 microversion: 2.1 time: 0.467617 Jul 24 01:12:11.807935 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 25/49] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:11 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1273 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:12.038392 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7eebe256-6c15-4add-8a81-8420763af1c0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:12.055924 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7eebe256-6c15-4add-8a81-8420763af1c0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1280 microversion: 2.1 time: 0.415562 Jul 24 01:12:12.056970 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 25/50] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:11 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1280 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:12.360538 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b60f7ed4-72c8-4936-9de0-4f3e62232c18 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:12.361178 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b60f7ed4-72c8-4936-9de0-4f3e62232c18 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:12.387952 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b60f7ed4-72c8-4936-9de0-4f3e62232c18 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.388306 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b60f7ed4-72c8-4936-9de0-4f3e62232c18 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.389153 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b60f7ed4-72c8-4936-9de0-4f3e62232c18 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.395462 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b60f7ed4-72c8-4936-9de0-4f3e62232c18 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.654346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5b58d6d2-1389-4380-9b20-9460f4dc1060 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:12.654986 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5b58d6d2-1389-4380-9b20-9460f4dc1060 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:12.686887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5b58d6d2-1389-4380-9b20-9460f4dc1060 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.686887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5b58d6d2-1389-4380-9b20-9460f4dc1060 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.686887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5b58d6d2-1389-4380-9b20-9460f4dc1060 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.686887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5b58d6d2-1389-4380-9b20-9460f4dc1060 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:13.076448 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5b58d6d2-1389-4380-9b20-9460f4dc1060 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:13.089781 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5b58d6d2-1389-4380-9b20-9460f4dc1060 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1299 microversion: 2.1 time: 0.437379 Jul 24 01:12:13.101951 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 26/51] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1299 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:13.119350 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9b584235-63f6-4383-8af1-b523e4067628 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:13.126428 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9b584235-63f6-4383-8af1-b523e4067628 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:13.138148 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9b584235-63f6-4383-8af1-b523e4067628 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:13.138896 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9b584235-63f6-4383-8af1-b523e4067628 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:13.139984 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9b584235-63f6-4383-8af1-b523e4067628 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:13.140632 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9b584235-63f6-4383-8af1-b523e4067628 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:13.686364 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b60f7ed4-72c8-4936-9de0-4f3e62232c18 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:13.702985 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b60f7ed4-72c8-4936-9de0-4f3e62232c18 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 1.346610 Jul 24 01:12:13.707277 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 26/52] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:13.728023 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1eff76a9-71f7-4574-a6d3-135fe7c788f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:13.729733 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1eff76a9-71f7-4574-a6d3-135fe7c788f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:13.757719 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1eff76a9-71f7-4574-a6d3-135fe7c788f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:13.760796 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1eff76a9-71f7-4574-a6d3-135fe7c788f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:13.768762 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1eff76a9-71f7-4574-a6d3-135fe7c788f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:13.770937 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1eff76a9-71f7-4574-a6d3-135fe7c788f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:14.402906 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=4 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:14.479090 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9b584235-63f6-4383-8af1-b523e4067628 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:14.488488 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9b584235-63f6-4383-8af1-b523e4067628 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 1.385151 Jul 24 01:12:14.492260 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 27/53] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:13 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:14.503624 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-67aa7d39-b910-43e7-83b1-05a98dba8ae8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:14.505642 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-67aa7d39-b910-43e7-83b1-05a98dba8ae8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:14.540885 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67aa7d39-b910-43e7-83b1-05a98dba8ae8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:14.543455 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67aa7d39-b910-43e7-83b1-05a98dba8ae8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:14.545900 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67aa7d39-b910-43e7-83b1-05a98dba8ae8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:14.549454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67aa7d39-b910-43e7-83b1-05a98dba8ae8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:15.152557 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-67aa7d39-b910-43e7-83b1-05a98dba8ae8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:15.170266 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-67aa7d39-b910-43e7-83b1-05a98dba8ae8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1299 microversion: 2.1 time: 0.672036 Jul 24 01:12:15.180231 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 28/54] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:14 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1299 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:15.180231 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2b0a9238-43b9-4558-be11-58ebc99e62e0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:15.180231 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2b0a9238-43b9-4558-be11-58ebc99e62e0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:15.202409 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:15.217471 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2b0a9238-43b9-4558-be11-58ebc99e62e0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:15.219975 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2b0a9238-43b9-4558-be11-58ebc99e62e0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:15.222348 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2b0a9238-43b9-4558-be11-58ebc99e62e0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:15.223703 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2b0a9238-43b9-4558-be11-58ebc99e62e0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:15.306719 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1eff76a9-71f7-4574-a6d3-135fe7c788f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:15.330246 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1eff76a9-71f7-4574-a6d3-135fe7c788f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 1.620187 Jul 24 01:12:15.332001 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 27/55] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:13 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:15.506718 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c36f5d44-0a97-4018-b8a3-b543b3f3df7e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:15.507727 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c36f5d44-0a97-4018-b8a3-b543b3f3df7e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:15.520860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c36f5d44-0a97-4018-b8a3-b543b3f3df7e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:15.521644 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c36f5d44-0a97-4018-b8a3-b543b3f3df7e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:15.522629 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c36f5d44-0a97-4018-b8a3-b543b3f3df7e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:15.523211 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c36f5d44-0a97-4018-b8a3-b543b3f3df7e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:16.335755 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=22 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:16.368064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2b0a9238-43b9-4558-be11-58ebc99e62e0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:16.383685 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2b0a9238-43b9-4558-be11-58ebc99e62e0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 1.211132 Jul 24 01:12:16.398181 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 29/56] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:15 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:16.414454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-787fd5a3-b6e5-48ba-bddb-a3ac88e11206 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:16.416258 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-787fd5a3-b6e5-48ba-bddb-a3ac88e11206 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:16.439617 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-787fd5a3-b6e5-48ba-bddb-a3ac88e11206 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:16.440477 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-787fd5a3-b6e5-48ba-bddb-a3ac88e11206 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:16.444586 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-787fd5a3-b6e5-48ba-bddb-a3ac88e11206 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:16.449917 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-787fd5a3-b6e5-48ba-bddb-a3ac88e11206 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:17.176233 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c36f5d44-0a97-4018-b8a3-b543b3f3df7e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:17.193424 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c36f5d44-0a97-4018-b8a3-b543b3f3df7e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 1.690919 Jul 24 01:12:17.195692 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 28/57] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:15 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:17.210023 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-78cab4de-258b-4eb2-9409-ee1c86e40369 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:17.211084 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-78cab4de-258b-4eb2-9409-ee1c86e40369 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:17.227604 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-78cab4de-258b-4eb2-9409-ee1c86e40369 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:17.228296 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-78cab4de-258b-4eb2-9409-ee1c86e40369 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:17.232384 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-78cab4de-258b-4eb2-9409-ee1c86e40369 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:17.233132 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-78cab4de-258b-4eb2-9409-ee1c86e40369 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:17.289043 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=6 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:17.403878 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=26 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:19.126446 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-78cab4de-258b-4eb2-9409-ee1c86e40369 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:19.137784 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-78cab4de-258b-4eb2-9409-ee1c86e40369 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 1.939069 Jul 24 01:12:19.138969 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 29/58] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:17 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:19.146514 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1e7d040a-49ce-458e-9bf4-9c59390bbd5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:19.162761 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1e7d040a-49ce-458e-9bf4-9c59390bbd5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:19.177808 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e7d040a-49ce-458e-9bf4-9c59390bbd5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.181591 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e7d040a-49ce-458e-9bf4-9c59390bbd5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:19.189756 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e7d040a-49ce-458e-9bf4-9c59390bbd5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.193039 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e7d040a-49ce-458e-9bf4-9c59390bbd5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:19.200523 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-787fd5a3-b6e5-48ba-bddb-a3ac88e11206 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:19.254517 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-787fd5a3-b6e5-48ba-bddb-a3ac88e11206 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 2.853898 Jul 24 01:12:19.262225 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:16 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 2863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:19.269762 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f183fb8f-2bca-49be-a37b-b75c4e0377eb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:19.271220 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f183fb8f-2bca-49be-a37b-b75c4e0377eb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:19.297216 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f183fb8f-2bca-49be-a37b-b75c4e0377eb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.298132 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f183fb8f-2bca-49be-a37b-b75c4e0377eb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:19.299361 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f183fb8f-2bca-49be-a37b-b75c4e0377eb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.299987 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f183fb8f-2bca-49be-a37b-b75c4e0377eb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:20.234902 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f183fb8f-2bca-49be-a37b-b75c4e0377eb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:20.247809 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f183fb8f-2bca-49be-a37b-b75c4e0377eb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.982896 Jul 24 01:12:20.249472 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 31/60] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:19 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:20.369150 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-c0c9c0c4-5ea1-4792-9138-ea4b6e3c7c77 req-3e4230a1-7dd0-4324-ad2c-70e4492a959b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "266d103a-6114-42ba-a840-13096deab642", "tag": "e5f7c4ed-65a6-4029-84af-705b8d828f64"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:20.402050 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-c0c9c0c4-5ea1-4792-9138-ea4b6e3c7c77 req-3e4230a1-7dd0-4324-ad2c-70e4492a959b service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:20.403790 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-c0c9c0c4-5ea1-4792-9138-ea4b6e3c7c77 req-3e4230a1-7dd0-4324-ad2c-70e4492a959b service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:20.437821 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1e7d040a-49ce-458e-9bf4-9c59390bbd5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:20.438961 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-c0c9c0c4-5ea1-4792-9138-ea4b6e3c7c77 req-3e4230a1-7dd0-4324-ad2c-70e4492a959b service nova] Creating event network-changed:e5f7c4ed-65a6-4029-84af-705b8d828f64 for instance 266d103a-6114-42ba-a840-13096deab642 on hv-cinder-maste Jul 24 01:12:20.439827 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-c0c9c0c4-5ea1-4792-9138-ea4b6e3c7c77 req-3e4230a1-7dd0-4324-ad2c-70e4492a959b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118036) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:12:20.441341 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f0f49bd-4a97-4a30-a202-2a1b10e8d066 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:20.442224 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f0f49bd-4a97-4a30-a202-2a1b10e8d066 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:20.444182 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f0f49bd-4a97-4a30-a202-2a1b10e8d066 None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:20.445120 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f0f49bd-4a97-4a30-a202-2a1b10e8d066 None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:20.453560 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1e7d040a-49ce-458e-9bf4-9c59390bbd5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 1.308541 Jul 24 01:12:20.454620 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 30/61] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:19 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:20.460651 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.compute.rpcapi [None req-4f0f49bd-4a97-4a30-a202-2a1b10e8d066 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 24 01:12:20.462058 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f0f49bd-4a97-4a30-a202-2a1b10e8d066 None None] Releasing lock "compute-rpcapi-router" {{(pid=118036) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:12:20.472505 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d4fd4695-551e-4d38-bf27-6e0a0b9b66af tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:20.482709 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d4fd4695-551e-4d38-bf27-6e0a0b9b66af tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:20.499727 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4f0f49bd-4a97-4a30-a202-2a1b10e8d066 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247449 Jul 24 01:12:20.500544 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 32/62] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:20.505684 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4fd4695-551e-4d38-bf27-6e0a0b9b66af tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:20.506969 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4fd4695-551e-4d38-bf27-6e0a0b9b66af tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:20.509047 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ae7a223e-c9a3-4217-bac2-42a123ac1b1f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:20.509693 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4fd4695-551e-4d38-bf27-6e0a0b9b66af tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:20.509801 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ae7a223e-c9a3-4217-bac2-42a123ac1b1f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:20.510299 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4fd4695-551e-4d38-bf27-6e0a0b9b66af tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:20.575739 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ae7a223e-c9a3-4217-bac2-42a123ac1b1f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:20.579346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ae7a223e-c9a3-4217-bac2-42a123ac1b1f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:20.582669 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ae7a223e-c9a3-4217-bac2-42a123ac1b1f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:20.585051 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ae7a223e-c9a3-4217-bac2-42a123ac1b1f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.034402 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d4fd4695-551e-4d38-bf27-6e0a0b9b66af tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:22.040505 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ae7a223e-c9a3-4217-bac2-42a123ac1b1f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:22.049386 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d4fd4695-551e-4d38-bf27-6e0a0b9b66af tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 1.593671 Jul 24 01:12:22.050652 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ae7a223e-c9a3-4217-bac2-42a123ac1b1f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 1.548820 Jul 24 01:12:22.054540 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 33/63] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:20 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:22.059454 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 31/64] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:20 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:22.069638 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1dddab9f-e418-434d-a931-b17efc6302a2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:22.070302 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1dddab9f-e418-434d-a931-b17efc6302a2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:22.086913 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1dddab9f-e418-434d-a931-b17efc6302a2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.087417 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1dddab9f-e418-434d-a931-b17efc6302a2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.088228 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1dddab9f-e418-434d-a931-b17efc6302a2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.088712 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1dddab9f-e418-434d-a931-b17efc6302a2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.296840 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-0621d20d-5036-4b0d-ba8d-57e749a49798 req-3616e194-d621-4ebe-8549-4450625d8d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da53513-cfab-4dee-9c4a-e9f3840a73d4", "tag": "a3dad938-ab34-4d5f-baea-de05eaf232c6"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:22.307168 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0621d20d-5036-4b0d-ba8d-57e749a49798 req-3616e194-d621-4ebe-8549-4450625d8d61 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.307987 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0621d20d-5036-4b0d-ba8d-57e749a49798 req-3616e194-d621-4ebe-8549-4450625d8d61 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.322033 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-0621d20d-5036-4b0d-ba8d-57e749a49798 req-3616e194-d621-4ebe-8549-4450625d8d61 service nova] Creating event network-changed:a3dad938-ab34-4d5f-baea-de05eaf232c6 for instance 6da53513-cfab-4dee-9c4a-e9f3840a73d4 on hv-cinder-maste Jul 24 01:12:22.327250 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-0621d20d-5036-4b0d-ba8d-57e749a49798 req-3616e194-d621-4ebe-8549-4450625d8d61 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271370 Jul 24 01:12:22.327887 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 34/65] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:22.333254 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ecc97ce3-38c9-416a-b39b-28be1fc4d0d9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:22.333960 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ecc97ce3-38c9-416a-b39b-28be1fc4d0d9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:22.340480 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ecc97ce3-38c9-416a-b39b-28be1fc4d0d9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.341197 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ecc97ce3-38c9-416a-b39b-28be1fc4d0d9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.342141 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ecc97ce3-38c9-416a-b39b-28be1fc4d0d9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.342586 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ecc97ce3-38c9-416a-b39b-28be1fc4d0d9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.442687 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1dddab9f-e418-434d-a931-b17efc6302a2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:22.466932 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1dddab9f-e418-434d-a931-b17efc6302a2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.406301 Jul 24 01:12:22.467573 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 32/66] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:22 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:22.509219 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ecc97ce3-38c9-416a-b39b-28be1fc4d0d9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:22.517857 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ecc97ce3-38c9-416a-b39b-28be1fc4d0d9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.188704 Jul 24 01:12:22.518908 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 35/67] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:22 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:22.564510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-820e6e1b-c8dc-42d9-93bf-e994e8412c12 req-f4ad33fc-9f83-4791-845c-5b44a33f7df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c12186-86f3-4887-9e0a-ed1b48f307ba", "tag": "d85b179a-7a05-4ea4-8139-bc1c8fc67296"}, {"name": "network-changed", "server_uuid": "e5b4f90c-bd24-4e24-9175-7c8bb57f1245", "tag": "10d1484e-6736-4cd1-a0dd-fea4d4375bbc"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:22.577540 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-820e6e1b-c8dc-42d9-93bf-e994e8412c12 req-f4ad33fc-9f83-4791-845c-5b44a33f7df8 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.578530 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-820e6e1b-c8dc-42d9-93bf-e994e8412c12 req-f4ad33fc-9f83-4791-845c-5b44a33f7df8 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.603596 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-820e6e1b-c8dc-42d9-93bf-e994e8412c12 req-f4ad33fc-9f83-4791-845c-5b44a33f7df8 service nova] Creating event network-changed:d85b179a-7a05-4ea4-8139-bc1c8fc67296 for instance 76c12186-86f3-4887-9e0a-ed1b48f307ba on hv-cinder-maste Jul 24 01:12:22.604287 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-820e6e1b-c8dc-42d9-93bf-e994e8412c12 req-f4ad33fc-9f83-4791-845c-5b44a33f7df8 service nova] Creating event network-changed:10d1484e-6736-4cd1-a0dd-fea4d4375bbc for instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 on hv-cinder-maste Jul 24 01:12:22.604925 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-820e6e1b-c8dc-42d9-93bf-e994e8412c12 req-f4ad33fc-9f83-4791-845c-5b44a33f7df8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118035) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:12:22.606287 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7c3f6118-485b-45a0-906f-75ba3f90dc07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.606824 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7c3f6118-485b-45a0-906f-75ba3f90dc07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.607853 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7c3f6118-485b-45a0-906f-75ba3f90dc07 None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.608523 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7c3f6118-485b-45a0-906f-75ba3f90dc07 None None] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.621148 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.compute.rpcapi [None req-7c3f6118-485b-45a0-906f-75ba3f90dc07 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 24 01:12:22.622135 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7c3f6118-485b-45a0-906f-75ba3f90dc07 None None] Releasing lock "compute-rpcapi-router" {{(pid=118035) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:12:22.640075 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7c3f6118-485b-45a0-906f-75ba3f90dc07 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079619 Jul 24 01:12:22.640770 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 33/68] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:23.070064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-981abefd-26d4-43bf-b041-122e5a9b9231 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:23.070833 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-981abefd-26d4-43bf-b041-122e5a9b9231 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:23.071523 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d5ae9598-9d8a-4b68-913b-91da0e5d98b3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:23.073007 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d5ae9598-9d8a-4b68-913b-91da0e5d98b3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:23.080762 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5ae9598-9d8a-4b68-913b-91da0e5d98b3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.081170 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5ae9598-9d8a-4b68-913b-91da0e5d98b3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.082039 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-981abefd-26d4-43bf-b041-122e5a9b9231 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.082296 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5ae9598-9d8a-4b68-913b-91da0e5d98b3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.082972 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5ae9598-9d8a-4b68-913b-91da0e5d98b3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.084999 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-981abefd-26d4-43bf-b041-122e5a9b9231 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.086244 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-981abefd-26d4-43bf-b041-122e5a9b9231 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.087388 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-981abefd-26d4-43bf-b041-122e5a9b9231 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.142264 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=100 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:23.334909 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-981abefd-26d4-43bf-b041-122e5a9b9231 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:23.337948 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d5ae9598-9d8a-4b68-913b-91da0e5d98b3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:23.344259 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-981abefd-26d4-43bf-b041-122e5a9b9231 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.279358 Jul 24 01:12:23.345211 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 36/69] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:23 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:23.350110 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d5ae9598-9d8a-4b68-913b-91da0e5d98b3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.282954 Jul 24 01:12:23.359636 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 34/70] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:23 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:23.489858 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-90079b04-e483-456f-8b2a-36bc228278e5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:23.491104 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-90079b04-e483-456f-8b2a-36bc228278e5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:23.498883 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-90079b04-e483-456f-8b2a-36bc228278e5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.499755 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-90079b04-e483-456f-8b2a-36bc228278e5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.500689 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-90079b04-e483-456f-8b2a-36bc228278e5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.501322 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-90079b04-e483-456f-8b2a-36bc228278e5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.534644 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8e0d2303-b598-472c-b564-cfb0f8b569ab tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:23.535259 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8e0d2303-b598-472c-b564-cfb0f8b569ab tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:23.542720 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e0d2303-b598-472c-b564-cfb0f8b569ab tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.543180 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e0d2303-b598-472c-b564-cfb0f8b569ab tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.547252 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e0d2303-b598-472c-b564-cfb0f8b569ab tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.547838 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e0d2303-b598-472c-b564-cfb0f8b569ab tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.952547 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-90079b04-e483-456f-8b2a-36bc228278e5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:23.970280 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-90079b04-e483-456f-8b2a-36bc228278e5 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.484668 Jul 24 01:12:23.970865 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 37/71] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:23 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:23.973721 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8e0d2303-b598-472c-b564-cfb0f8b569ab tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:23.986773 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8e0d2303-b598-472c-b564-cfb0f8b569ab tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.456003 Jul 24 01:12:23.991559 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 35/72] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:23 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:24.349987 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-75ca4b7f-dc8a-4aa1-b2cf-f3775c949d8a req-97377f51-3b10-40a8-83b4-5df4de6e2660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76253536-dc6f-41fe-b9b9-07f62cd2ea50", "tag": "1140d1a5-d0e0-4a81-83a0-d2ef896b5b43"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:24.362534 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1c450017-5bdc-451f-9a59-60e95ed5f0e9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.363179 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1c450017-5bdc-451f-9a59-60e95ed5f0e9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:24.368391 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-75ca4b7f-dc8a-4aa1-b2cf-f3775c949d8a req-97377f51-3b10-40a8-83b4-5df4de6e2660 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.369304 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-75ca4b7f-dc8a-4aa1-b2cf-f3775c949d8a req-97377f51-3b10-40a8-83b4-5df4de6e2660 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.372296 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1c450017-5bdc-451f-9a59-60e95ed5f0e9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.372748 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1c450017-5bdc-451f-9a59-60e95ed5f0e9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.373520 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1c450017-5bdc-451f-9a59-60e95ed5f0e9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.373946 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1c450017-5bdc-451f-9a59-60e95ed5f0e9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.383811 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-75ca4b7f-dc8a-4aa1-b2cf-f3775c949d8a req-97377f51-3b10-40a8-83b4-5df4de6e2660 service nova] Creating event network-changed:1140d1a5-d0e0-4a81-83a0-d2ef896b5b43 for instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 on hv-cinder-maste Jul 24 01:12:24.393185 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-75ca4b7f-dc8a-4aa1-b2cf-f3775c949d8a req-97377f51-3b10-40a8-83b4-5df4de6e2660 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051525 Jul 24 01:12:24.394425 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 38/73] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:24.402978 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-65a10e03-9502-4bef-99a3-ce8208ccf44a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.403811 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-65a10e03-9502-4bef-99a3-ce8208ccf44a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:24.413634 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-65a10e03-9502-4bef-99a3-ce8208ccf44a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.414235 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-65a10e03-9502-4bef-99a3-ce8208ccf44a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.415081 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-65a10e03-9502-4bef-99a3-ce8208ccf44a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.415836 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-65a10e03-9502-4bef-99a3-ce8208ccf44a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.667074 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-65a10e03-9502-4bef-99a3-ce8208ccf44a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:24.669235 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1c450017-5bdc-451f-9a59-60e95ed5f0e9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:24.677546 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1c450017-5bdc-451f-9a59-60e95ed5f0e9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.320354 Jul 24 01:12:24.678996 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 36/74] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:24.681115 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-65a10e03-9502-4bef-99a3-ce8208ccf44a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.283586 Jul 24 01:12:24.690015 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 39/75] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:24.987640 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9d62a651-d4a5-4e84-8d62-3b9e88e8f596 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.988657 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9d62a651-d4a5-4e84-8d62-3b9e88e8f596 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:24.997157 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9d62a651-d4a5-4e84-8d62-3b9e88e8f596 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.997964 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9d62a651-d4a5-4e84-8d62-3b9e88e8f596 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.007836 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-251045c2-1c73-4cd9-8464-41df91ab1721 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:25.009011 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-251045c2-1c73-4cd9-8464-41df91ab1721 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:25.016511 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9d62a651-d4a5-4e84-8d62-3b9e88e8f596 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.018136 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9d62a651-d4a5-4e84-8d62-3b9e88e8f596 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.024270 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-251045c2-1c73-4cd9-8464-41df91ab1721 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.026214 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-251045c2-1c73-4cd9-8464-41df91ab1721 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.027050 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-251045c2-1c73-4cd9-8464-41df91ab1721 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.027521 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-251045c2-1c73-4cd9-8464-41df91ab1721 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.045297 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=99 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:25.378812 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9d62a651-d4a5-4e84-8d62-3b9e88e8f596 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:25.380061 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-251045c2-1c73-4cd9-8464-41df91ab1721 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:25.388819 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-251045c2-1c73-4cd9-8464-41df91ab1721 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.388337 Jul 24 01:12:25.392238 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9d62a651-d4a5-4e84-8d62-3b9e88e8f596 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.408516 Jul 24 01:12:25.403111 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 37/76] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:25.412688 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 40/77] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:25.696111 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-caa32777-8e02-4edf-81ea-79a0368a1d89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:25.697172 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-caa32777-8e02-4edf-81ea-79a0368a1d89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:25.699594 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:25.705095 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5d21898e-d54b-4c13-a668-f1736574ede0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:25.705977 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5d21898e-d54b-4c13-a668-f1736574ede0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:25.709650 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-caa32777-8e02-4edf-81ea-79a0368a1d89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.710331 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-caa32777-8e02-4edf-81ea-79a0368a1d89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.711349 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-caa32777-8e02-4edf-81ea-79a0368a1d89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.711754 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-caa32777-8e02-4edf-81ea-79a0368a1d89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.713341 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5d21898e-d54b-4c13-a668-f1736574ede0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.714172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5d21898e-d54b-4c13-a668-f1736574ede0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.715338 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5d21898e-d54b-4c13-a668-f1736574ede0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.716415 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5d21898e-d54b-4c13-a668-f1736574ede0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.940185 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-caa32777-8e02-4edf-81ea-79a0368a1d89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:25.949525 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-caa32777-8e02-4edf-81ea-79a0368a1d89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.258782 Jul 24 01:12:25.956382 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 38/78] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:25 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:25.967658 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5d21898e-d54b-4c13-a668-f1736574ede0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:25.975651 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5d21898e-d54b-4c13-a668-f1736574ede0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.278290 Jul 24 01:12:25.976975 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 41/79] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:25 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:26.414692 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c8c993ef-9d82-4521-b5d8-4cb9dc77e8b1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:26.415876 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-92a5af75-fef6-4e50-a624-fdfa8205f1cb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:26.417034 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-92a5af75-fef6-4e50-a624-fdfa8205f1cb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:26.417853 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c8c993ef-9d82-4521-b5d8-4cb9dc77e8b1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:26.433088 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-92a5af75-fef6-4e50-a624-fdfa8205f1cb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:26.433633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-92a5af75-fef6-4e50-a624-fdfa8205f1cb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:26.434497 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-92a5af75-fef6-4e50-a624-fdfa8205f1cb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:26.434888 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8c993ef-9d82-4521-b5d8-4cb9dc77e8b1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:26.435589 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8c993ef-9d82-4521-b5d8-4cb9dc77e8b1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:26.436228 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-92a5af75-fef6-4e50-a624-fdfa8205f1cb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:26.437321 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8c993ef-9d82-4521-b5d8-4cb9dc77e8b1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:26.440150 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8c993ef-9d82-4521-b5d8-4cb9dc77e8b1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:26.660366 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c8c993ef-9d82-4521-b5d8-4cb9dc77e8b1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:26.667895 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c8c993ef-9d82-4521-b5d8-4cb9dc77e8b1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.264593 Jul 24 01:12:26.668658 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 39/80] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:26 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:26.678962 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-92a5af75-fef6-4e50-a624-fdfa8205f1cb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:26.678962 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-92a5af75-fef6-4e50-a624-fdfa8205f1cb tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.272182 Jul 24 01:12:26.678962 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 42/81] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:26 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:26.970523 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f4bc9a95-d8ea-4162-aad6-6c57dbf161f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:26.971179 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f4bc9a95-d8ea-4162-aad6-6c57dbf161f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:26.984664 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f4bc9a95-d8ea-4162-aad6-6c57dbf161f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:26.985082 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f4bc9a95-d8ea-4162-aad6-6c57dbf161f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:26.986872 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f4bc9a95-d8ea-4162-aad6-6c57dbf161f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:26.987845 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f4bc9a95-d8ea-4162-aad6-6c57dbf161f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:27.000523 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-bc52d375-c63f-47e4-b056-ce59da4a2df2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:27.002169 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-bc52d375-c63f-47e4-b056-ce59da4a2df2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:27.026246 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bc52d375-c63f-47e4-b056-ce59da4a2df2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:27.029114 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bc52d375-c63f-47e4-b056-ce59da4a2df2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:27.030311 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bc52d375-c63f-47e4-b056-ce59da4a2df2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:27.032751 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bc52d375-c63f-47e4-b056-ce59da4a2df2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:27.204273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f4bc9a95-d8ea-4162-aad6-6c57dbf161f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:27.214386 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f4bc9a95-d8ea-4162-aad6-6c57dbf161f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.249083 Jul 24 01:12:27.215605 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 40/82] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:26 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:27.260619 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-bc52d375-c63f-47e4-b056-ce59da4a2df2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:27.268083 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-bc52d375-c63f-47e4-b056-ce59da4a2df2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.273647 Jul 24 01:12:27.268644 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 43/83] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:26 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:27.686088 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8efbe159-a843-4619-a101-22f45abbce7c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:27.687288 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8efbe159-a843-4619-a101-22f45abbce7c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:27.694801 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8a75423d-6eb1-4017-bf49-a0126a63b80d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:27.696031 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8a75423d-6eb1-4017-bf49-a0126a63b80d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:27.705570 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8a75423d-6eb1-4017-bf49-a0126a63b80d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:27.707729 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8efbe159-a843-4619-a101-22f45abbce7c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:27.708420 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8a75423d-6eb1-4017-bf49-a0126a63b80d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:27.709045 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8efbe159-a843-4619-a101-22f45abbce7c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:27.710022 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8a75423d-6eb1-4017-bf49-a0126a63b80d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:27.710977 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8efbe159-a843-4619-a101-22f45abbce7c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:27.711639 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8a75423d-6eb1-4017-bf49-a0126a63b80d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:27.716502 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8efbe159-a843-4619-a101-22f45abbce7c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.083914 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8a75423d-6eb1-4017-bf49-a0126a63b80d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:28.086250 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8efbe159-a843-4619-a101-22f45abbce7c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:28.094160 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8efbe159-a843-4619-a101-22f45abbce7c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.411900 Jul 24 01:12:28.095983 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8a75423d-6eb1-4017-bf49-a0126a63b80d tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.405020 Jul 24 01:12:28.096635 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 44/84] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:27 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:28.125183 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 41/85] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:27 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:28.232862 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-deb15bd1-14c6-40d9-be41-4d335742c826 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:28.233940 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-deb15bd1-14c6-40d9-be41-4d335742c826 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:28.240801 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-deb15bd1-14c6-40d9-be41-4d335742c826 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.241471 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-deb15bd1-14c6-40d9-be41-4d335742c826 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.242347 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-deb15bd1-14c6-40d9-be41-4d335742c826 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.243120 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-deb15bd1-14c6-40d9-be41-4d335742c826 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.284999 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-022201e8-2023-46e4-9e8c-6d20d0478c2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:28.285740 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-022201e8-2023-46e4-9e8c-6d20d0478c2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:28.291849 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-022201e8-2023-46e4-9e8c-6d20d0478c2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.292355 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-022201e8-2023-46e4-9e8c-6d20d0478c2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.293181 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-022201e8-2023-46e4-9e8c-6d20d0478c2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.293673 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-022201e8-2023-46e4-9e8c-6d20d0478c2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.449727 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-deb15bd1-14c6-40d9-be41-4d335742c826 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:28.458878 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-deb15bd1-14c6-40d9-be41-4d335742c826 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.229975 Jul 24 01:12:28.459720 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 45/86] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:28 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:28.476864 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-022201e8-2023-46e4-9e8c-6d20d0478c2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:28.484326 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-022201e8-2023-46e4-9e8c-6d20d0478c2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.203068 Jul 24 01:12:28.484891 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 42/87] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:28 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:29.110698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4a541801-ebfb-41d8-ae45-149089a87499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:29.111487 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4a541801-ebfb-41d8-ae45-149089a87499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:29.114399 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-93e4b972-68b6-456d-85cf-91f78ab8828b tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:29.115052 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-93e4b972-68b6-456d-85cf-91f78ab8828b tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:29.118067 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4a541801-ebfb-41d8-ae45-149089a87499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.118511 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4a541801-ebfb-41d8-ae45-149089a87499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.119266 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4a541801-ebfb-41d8-ae45-149089a87499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.119718 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4a541801-ebfb-41d8-ae45-149089a87499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.121999 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-93e4b972-68b6-456d-85cf-91f78ab8828b tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.122692 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-93e4b972-68b6-456d-85cf-91f78ab8828b tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.123571 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-93e4b972-68b6-456d-85cf-91f78ab8828b tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.124103 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-93e4b972-68b6-456d-85cf-91f78ab8828b tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.318565 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4a541801-ebfb-41d8-ae45-149089a87499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:29.319793 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-93e4b972-68b6-456d-85cf-91f78ab8828b tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:29.328507 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4a541801-ebfb-41d8-ae45-149089a87499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.221804 Jul 24 01:12:29.328727 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-93e4b972-68b6-456d-85cf-91f78ab8828b tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.218446 Jul 24 01:12:29.329229 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 46/88] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:29 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:29.329609 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 43/89] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:29 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:29.480335 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c6b17a72-c8c3-4658-b532-712a82c4eca5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:29.481354 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c6b17a72-c8c3-4658-b532-712a82c4eca5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:29.490928 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c6b17a72-c8c3-4658-b532-712a82c4eca5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.491674 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c6b17a72-c8c3-4658-b532-712a82c4eca5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.492617 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c6b17a72-c8c3-4658-b532-712a82c4eca5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.493196 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c6b17a72-c8c3-4658-b532-712a82c4eca5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.502834 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-00998372-033e-4971-a48c-105d61dbecd5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:29.503780 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-00998372-033e-4971-a48c-105d61dbecd5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:29.510397 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-00998372-033e-4971-a48c-105d61dbecd5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.510781 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-00998372-033e-4971-a48c-105d61dbecd5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.511670 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-00998372-033e-4971-a48c-105d61dbecd5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.512041 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-00998372-033e-4971-a48c-105d61dbecd5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.692579 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c6b17a72-c8c3-4658-b532-712a82c4eca5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:29.698133 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-00998372-033e-4971-a48c-105d61dbecd5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:29.701595 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c6b17a72-c8c3-4658-b532-712a82c4eca5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.227394 Jul 24 01:12:29.702208 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 47/90] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:29 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:29.707133 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-00998372-033e-4971-a48c-105d61dbecd5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.208777 Jul 24 01:12:29.712054 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 44/91] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:29 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:30.345455 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-cdac1c86-de77-4c8b-8e43-5e95fa2d1b93 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:30.346051 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-cdac1c86-de77-4c8b-8e43-5e95fa2d1b93 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:30.346303 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9f93eb0b-3bbf-4fb8-a981-4db6d5622e74 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:30.347119 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9f93eb0b-3bbf-4fb8-a981-4db6d5622e74 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:30.353116 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cdac1c86-de77-4c8b-8e43-5e95fa2d1b93 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.353616 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f93eb0b-3bbf-4fb8-a981-4db6d5622e74 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.354136 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cdac1c86-de77-4c8b-8e43-5e95fa2d1b93 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.354259 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f93eb0b-3bbf-4fb8-a981-4db6d5622e74 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.355041 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f93eb0b-3bbf-4fb8-a981-4db6d5622e74 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.355320 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cdac1c86-de77-4c8b-8e43-5e95fa2d1b93 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.355551 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f93eb0b-3bbf-4fb8-a981-4db6d5622e74 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.356064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cdac1c86-de77-4c8b-8e43-5e95fa2d1b93 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.459782 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:30.560781 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9f93eb0b-3bbf-4fb8-a981-4db6d5622e74 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:30.569119 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9f93eb0b-3bbf-4fb8-a981-4db6d5622e74 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.226960 Jul 24 01:12:30.578745 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cdac1c86-de77-4c8b-8e43-5e95fa2d1b93 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:30.579246 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 45/92] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:30 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:30.595560 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-cdac1c86-de77-4c8b-8e43-5e95fa2d1b93 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.253937 Jul 24 01:12:30.596150 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 48/93] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:30 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:30.720590 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a29801a1-fee4-42bd-ac74-dff5f20420aa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:30.724049 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a29801a1-fee4-42bd-ac74-dff5f20420aa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:30.727123 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6245da76-e92b-4373-bebc-b9f43985fc01 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:30.728469 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6245da76-e92b-4373-bebc-b9f43985fc01 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:30.731891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a29801a1-fee4-42bd-ac74-dff5f20420aa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.732866 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a29801a1-fee4-42bd-ac74-dff5f20420aa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.733809 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a29801a1-fee4-42bd-ac74-dff5f20420aa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.734371 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a29801a1-fee4-42bd-ac74-dff5f20420aa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.735914 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6245da76-e92b-4373-bebc-b9f43985fc01 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.736355 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6245da76-e92b-4373-bebc-b9f43985fc01 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.737124 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6245da76-e92b-4373-bebc-b9f43985fc01 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.737774 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6245da76-e92b-4373-bebc-b9f43985fc01 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.937350 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a29801a1-fee4-42bd-ac74-dff5f20420aa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:30.939975 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6245da76-e92b-4373-bebc-b9f43985fc01 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:30.945774 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a29801a1-fee4-42bd-ac74-dff5f20420aa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.231466 Jul 24 01:12:30.946377 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 46/94] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:30 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:30.949156 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6245da76-e92b-4373-bebc-b9f43985fc01 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.227151 Jul 24 01:12:30.950133 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 49/95] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:30 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:31.586428 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1d840873-d9f7-4ade-98fd-f1d05849e315 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:31.587041 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1d840873-d9f7-4ade-98fd-f1d05849e315 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:31.593300 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1d840873-d9f7-4ade-98fd-f1d05849e315 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.593746 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1d840873-d9f7-4ade-98fd-f1d05849e315 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:31.594507 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1d840873-d9f7-4ade-98fd-f1d05849e315 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.595055 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1d840873-d9f7-4ade-98fd-f1d05849e315 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:31.613310 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-fba98868-2320-4c63-bb91-d3616513d452 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:31.614238 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-fba98868-2320-4c63-bb91-d3616513d452 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:31.621297 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fba98868-2320-4c63-bb91-d3616513d452 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.621964 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fba98868-2320-4c63-bb91-d3616513d452 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:31.622726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fba98868-2320-4c63-bb91-d3616513d452 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.623194 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fba98868-2320-4c63-bb91-d3616513d452 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:31.810618 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1d840873-d9f7-4ade-98fd-f1d05849e315 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:31.817151 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-fba98868-2320-4c63-bb91-d3616513d452 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:31.829099 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-fba98868-2320-4c63-bb91-d3616513d452 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.219991 Jul 24 01:12:31.830401 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 50/96] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:31 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:31.840994 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1d840873-d9f7-4ade-98fd-f1d05849e315 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.258606 Jul 24 01:12:31.842847 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 47/97] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:31 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:31.962558 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c76e42f8-607a-4850-994d-8776071a107f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:31.963208 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c76e42f8-607a-4850-994d-8776071a107f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:31.966800 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e4a3e5f8-6e86-4c7f-9639-11182e952a87 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:31.967446 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e4a3e5f8-6e86-4c7f-9639-11182e952a87 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:31.969474 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c76e42f8-607a-4850-994d-8776071a107f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.970335 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c76e42f8-607a-4850-994d-8776071a107f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:31.971485 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c76e42f8-607a-4850-994d-8776071a107f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.972248 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c76e42f8-607a-4850-994d-8776071a107f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:31.974959 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e4a3e5f8-6e86-4c7f-9639-11182e952a87 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.975570 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e4a3e5f8-6e86-4c7f-9639-11182e952a87 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:31.976668 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e4a3e5f8-6e86-4c7f-9639-11182e952a87 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.977112 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e4a3e5f8-6e86-4c7f-9639-11182e952a87 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.179562 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e4a3e5f8-6e86-4c7f-9639-11182e952a87 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:32.182280 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c76e42f8-607a-4850-994d-8776071a107f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:32.188262 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e4a3e5f8-6e86-4c7f-9639-11182e952a87 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.226238 Jul 24 01:12:32.189518 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c76e42f8-607a-4850-994d-8776071a107f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.231408 Jul 24 01:12:32.189659 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 48/98] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:31 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:32.190411 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 51/99] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:31 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:32.847601 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4e300403-37b1-4b74-8e9d-6ddf69c0bbd2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.848205 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4e300403-37b1-4b74-8e9d-6ddf69c0bbd2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:32.851221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:32.858847 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4e300403-37b1-4b74-8e9d-6ddf69c0bbd2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.859496 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4e300403-37b1-4b74-8e9d-6ddf69c0bbd2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.859767 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b5d89cd1-1ed3-4ccc-bd16-d2feda35f839 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.861644 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4e300403-37b1-4b74-8e9d-6ddf69c0bbd2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.861769 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b5d89cd1-1ed3-4ccc-bd16-d2feda35f839 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:32.861857 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4e300403-37b1-4b74-8e9d-6ddf69c0bbd2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.869185 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b5d89cd1-1ed3-4ccc-bd16-d2feda35f839 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.871402 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b5d89cd1-1ed3-4ccc-bd16-d2feda35f839 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.872407 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b5d89cd1-1ed3-4ccc-bd16-d2feda35f839 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.873037 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b5d89cd1-1ed3-4ccc-bd16-d2feda35f839 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.345227 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b5d89cd1-1ed3-4ccc-bd16-d2feda35f839 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:33.360249 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b5d89cd1-1ed3-4ccc-bd16-d2feda35f839 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.504658 Jul 24 01:12:33.360861 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 52/100] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:32 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:33.365782 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9a16e392-93f2-45e2-9448-3b94aee13da1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:33.367585 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9a16e392-93f2-45e2-9448-3b94aee13da1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:33.378166 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9a16e392-93f2-45e2-9448-3b94aee13da1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:33.378712 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9a16e392-93f2-45e2-9448-3b94aee13da1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.384662 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9a16e392-93f2-45e2-9448-3b94aee13da1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:33.386173 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4e300403-37b1-4b74-8e9d-6ddf69c0bbd2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:33.388024 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9a16e392-93f2-45e2-9448-3b94aee13da1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.397288 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4e300403-37b1-4b74-8e9d-6ddf69c0bbd2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.554068 Jul 24 01:12:33.398383 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 49/101] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:32 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:33.406281 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-04c9f4b4-c6a8-46f7-8ac6-c521ebd93721 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:33.407090 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-04c9f4b4-c6a8-46f7-8ac6-c521ebd93721 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:33.415197 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-04c9f4b4-c6a8-46f7-8ac6-c521ebd93721 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:33.415986 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-04c9f4b4-c6a8-46f7-8ac6-c521ebd93721 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.417262 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-04c9f4b4-c6a8-46f7-8ac6-c521ebd93721 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:33.417887 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-04c9f4b4-c6a8-46f7-8ac6-c521ebd93721 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.831912 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-04c9f4b4-c6a8-46f7-8ac6-c521ebd93721 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:33.843622 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9a16e392-93f2-45e2-9448-3b94aee13da1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:33.846954 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=100 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:33.853130 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-04c9f4b4-c6a8-46f7-8ac6-c521ebd93721 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.453517 Jul 24 01:12:33.855916 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 50/102] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:33 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:33.866204 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9a16e392-93f2-45e2-9448-3b94aee13da1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.504143 Jul 24 01:12:33.875649 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 53/103] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:33 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:34.377068 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-803f9628-7382-402e-8806-427cc31c73c2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:34.377754 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-803f9628-7382-402e-8806-427cc31c73c2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:34.384482 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-803f9628-7382-402e-8806-427cc31c73c2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.385121 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-803f9628-7382-402e-8806-427cc31c73c2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.385883 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-803f9628-7382-402e-8806-427cc31c73c2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.386312 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-803f9628-7382-402e-8806-427cc31c73c2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.414278 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-12ed1bc1-c9fd-4f16-9b36-6df35f49c6c7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:34.415197 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-12ed1bc1-c9fd-4f16-9b36-6df35f49c6c7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:34.421682 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-12ed1bc1-c9fd-4f16-9b36-6df35f49c6c7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.422252 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-12ed1bc1-c9fd-4f16-9b36-6df35f49c6c7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.423107 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-12ed1bc1-c9fd-4f16-9b36-6df35f49c6c7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.423652 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-12ed1bc1-c9fd-4f16-9b36-6df35f49c6c7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.648444 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-803f9628-7382-402e-8806-427cc31c73c2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:34.651509 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-12ed1bc1-c9fd-4f16-9b36-6df35f49c6c7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:34.658610 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-803f9628-7382-402e-8806-427cc31c73c2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.284903 Jul 24 01:12:34.659374 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 51/104] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:34 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:34.661153 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-12ed1bc1-c9fd-4f16-9b36-6df35f49c6c7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.251048 Jul 24 01:12:34.661914 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 54/105] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:34 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:34.870617 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4f8690bb-06f4-4023-9e4a-793c89ff2de2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:34.871391 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4f8690bb-06f4-4023-9e4a-793c89ff2de2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:34.877705 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4f8690bb-06f4-4023-9e4a-793c89ff2de2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.878076 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4f8690bb-06f4-4023-9e4a-793c89ff2de2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.878850 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4f8690bb-06f4-4023-9e4a-793c89ff2de2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.879285 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4f8690bb-06f4-4023-9e4a-793c89ff2de2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.885760 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1702d207-a8c9-4ef8-854b-0cff00da708c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:34.887408 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1702d207-a8c9-4ef8-854b-0cff00da708c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:34.895996 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1702d207-a8c9-4ef8-854b-0cff00da708c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.896732 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1702d207-a8c9-4ef8-854b-0cff00da708c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.897664 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1702d207-a8c9-4ef8-854b-0cff00da708c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.898367 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1702d207-a8c9-4ef8-854b-0cff00da708c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.148806 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4f8690bb-06f4-4023-9e4a-793c89ff2de2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:35.159911 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4f8690bb-06f4-4023-9e4a-793c89ff2de2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.293679 Jul 24 01:12:35.160714 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 52/106] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:34 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:35.166998 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1702d207-a8c9-4ef8-854b-0cff00da708c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:35.178898 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1702d207-a8c9-4ef8-854b-0cff00da708c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.299363 Jul 24 01:12:35.184117 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 55/107] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:34 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:35.677812 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6541cdb1-0f0b-4070-8426-34503a6a3b84 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:35.678778 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6541cdb1-0f0b-4070-8426-34503a6a3b84 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:35.679698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0f281452-f64b-4c05-8d60-462741c690e2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:35.680735 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0f281452-f64b-4c05-8d60-462741c690e2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:35.686653 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6541cdb1-0f0b-4070-8426-34503a6a3b84 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.687116 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6541cdb1-0f0b-4070-8426-34503a6a3b84 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.688909 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6541cdb1-0f0b-4070-8426-34503a6a3b84 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.689349 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6541cdb1-0f0b-4070-8426-34503a6a3b84 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.693152 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0f281452-f64b-4c05-8d60-462741c690e2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.694082 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0f281452-f64b-4c05-8d60-462741c690e2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.695250 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0f281452-f64b-4c05-8d60-462741c690e2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.695939 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0f281452-f64b-4c05-8d60-462741c690e2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.993222 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6541cdb1-0f0b-4070-8426-34503a6a3b84 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:35.996463 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-0f281452-f64b-4c05-8d60-462741c690e2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:35.996901 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=100 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:36.004293 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6541cdb1-0f0b-4070-8426-34503a6a3b84 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.329460 Jul 24 01:12:36.004654 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0f281452-f64b-4c05-8d60-462741c690e2 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.330607 Jul 24 01:12:36.015337 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 56/109] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:35 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:36.015713 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 53/109] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:35 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:36.198984 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-078b02fc-1e9f-41c5-9521-f47883d35faa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:36.201517 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-078b02fc-1e9f-41c5-9521-f47883d35faa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:36.219423 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-078b02fc-1e9f-41c5-9521-f47883d35faa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:36.220308 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-078b02fc-1e9f-41c5-9521-f47883d35faa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:36.220733 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-56d29662-7283-4b5d-aef7-233726498509 req-35a0801b-59bc-49ae-906e-0d45c6231403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266d103a-6114-42ba-a840-13096deab642", "name": "network-vif-plugged", "status": "completed", "tag": "e5f7c4ed-65a6-4029-84af-705b8d828f64"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:36.225276 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-078b02fc-1e9f-41c5-9521-f47883d35faa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:36.228558 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-078b02fc-1e9f-41c5-9521-f47883d35faa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:36.238645 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-56d29662-7283-4b5d-aef7-233726498509 req-35a0801b-59bc-49ae-906e-0d45c6231403 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:36.242582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-56d29662-7283-4b5d-aef7-233726498509 req-35a0801b-59bc-49ae-906e-0d45c6231403 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:36.295514 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-56d29662-7283-4b5d-aef7-233726498509 req-35a0801b-59bc-49ae-906e-0d45c6231403 service nova] Creating event network-vif-plugged:e5f7c4ed-65a6-4029-84af-705b8d828f64 for instance 266d103a-6114-42ba-a840-13096deab642 on hv-cinder-maste Jul 24 01:12:36.319970 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-56d29662-7283-4b5d-aef7-233726498509 req-35a0801b-59bc-49ae-906e-0d45c6231403 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312487 Jul 24 01:12:36.322105 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 57/110] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:36.331815 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5f4e6850-7922-40af-b8aa-f70804ceeab9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:36.350110 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5f4e6850-7922-40af-b8aa-f70804ceeab9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:36.360534 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5f4e6850-7922-40af-b8aa-f70804ceeab9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:36.361374 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5f4e6850-7922-40af-b8aa-f70804ceeab9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:36.362909 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5f4e6850-7922-40af-b8aa-f70804ceeab9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:36.363536 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5f4e6850-7922-40af-b8aa-f70804ceeab9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:36.534556 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-078b02fc-1e9f-41c5-9521-f47883d35faa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:36.546756 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-078b02fc-1e9f-41c5-9521-f47883d35faa tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.368640 Jul 24 01:12:36.548056 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 54/111] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:36 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:36.590939 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5f4e6850-7922-40af-b8aa-f70804ceeab9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:36.601714 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5f4e6850-7922-40af-b8aa-f70804ceeab9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.276740 Jul 24 01:12:36.622508 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 58/112] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:36 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:37.023557 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e164883f-0edb-4f62-a4f4-7222aba9fcff tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:37.024831 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e164883f-0edb-4f62-a4f4-7222aba9fcff tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:37.030301 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-afe0dad3-2627-4518-829e-6ba86a39d470 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:37.031467 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-afe0dad3-2627-4518-829e-6ba86a39d470 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:37.032216 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e164883f-0edb-4f62-a4f4-7222aba9fcff tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.033144 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e164883f-0edb-4f62-a4f4-7222aba9fcff tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.034299 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e164883f-0edb-4f62-a4f4-7222aba9fcff tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.034728 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e164883f-0edb-4f62-a4f4-7222aba9fcff tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.045934 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-afe0dad3-2627-4518-829e-6ba86a39d470 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.046432 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-afe0dad3-2627-4518-829e-6ba86a39d470 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.047247 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-afe0dad3-2627-4518-829e-6ba86a39d470 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.047903 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-afe0dad3-2627-4518-829e-6ba86a39d470 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.297689 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e164883f-0edb-4f62-a4f4-7222aba9fcff tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:37.306611 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e164883f-0edb-4f62-a4f4-7222aba9fcff tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.288822 Jul 24 01:12:37.311203 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 55/113] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:37 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:37.317340 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-afe0dad3-2627-4518-829e-6ba86a39d470 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:37.325622 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-afe0dad3-2627-4518-829e-6ba86a39d470 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.300849 Jul 24 01:12:37.326190 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 59/114] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:37 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:37.564802 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-acf1139b-508c-470a-9f4d-4c8e91842712 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:37.565427 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-acf1139b-508c-470a-9f4d-4c8e91842712 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:37.578938 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acf1139b-508c-470a-9f4d-4c8e91842712 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.579427 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acf1139b-508c-470a-9f4d-4c8e91842712 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.580216 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acf1139b-508c-470a-9f4d-4c8e91842712 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.580653 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acf1139b-508c-470a-9f4d-4c8e91842712 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.626590 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f158616b-2777-4416-84b8-3a1a7d6e7688 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:37.627174 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f158616b-2777-4416-84b8-3a1a7d6e7688 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:37.645088 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f158616b-2777-4416-84b8-3a1a7d6e7688 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.657428 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f158616b-2777-4416-84b8-3a1a7d6e7688 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.658630 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f158616b-2777-4416-84b8-3a1a7d6e7688 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.659078 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f158616b-2777-4416-84b8-3a1a7d6e7688 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.894399 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-acf1139b-508c-470a-9f4d-4c8e91842712 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:37.910434 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-acf1139b-508c-470a-9f4d-4c8e91842712 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.349437 Jul 24 01:12:37.921645 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 56/115] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:37 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:37.942542 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f158616b-2777-4416-84b8-3a1a7d6e7688 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:37.955024 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f158616b-2777-4416-84b8-3a1a7d6e7688 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.331841 Jul 24 01:12:37.955721 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 60/116] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:37 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:38.327985 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-44dc6732-fcbd-4175-904a-e63e80ee7d0b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:38.332278 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-44dc6732-fcbd-4175-904a-e63e80ee7d0b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:38.344644 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-81d24fb1-4ab3-4fea-b227-af147c85166c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:38.345328 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-81d24fb1-4ab3-4fea-b227-af147c85166c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:38.348952 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-44dc6732-fcbd-4175-904a-e63e80ee7d0b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.349751 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-44dc6732-fcbd-4175-904a-e63e80ee7d0b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.350915 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-44dc6732-fcbd-4175-904a-e63e80ee7d0b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.351597 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-44dc6732-fcbd-4175-904a-e63e80ee7d0b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.353009 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81d24fb1-4ab3-4fea-b227-af147c85166c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.353460 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81d24fb1-4ab3-4fea-b227-af147c85166c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.354226 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81d24fb1-4ab3-4fea-b227-af147c85166c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.354659 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81d24fb1-4ab3-4fea-b227-af147c85166c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.574703 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-44dc6732-fcbd-4175-904a-e63e80ee7d0b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:38.576827 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-81d24fb1-4ab3-4fea-b227-af147c85166c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:38.582579 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-44dc6732-fcbd-4175-904a-e63e80ee7d0b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.258590 Jul 24 01:12:38.583158 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 57/117] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:38 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:38.584587 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-81d24fb1-4ab3-4fea-b227-af147c85166c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.246210 Jul 24 01:12:38.585310 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 61/118] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:38 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:38.588042 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-9fdde160-3576-48c2-8ccc-74cda66ef68a req-428aed54-52e9-4c0b-a7cd-fc769bc1ab69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da53513-cfab-4dee-9c4a-e9f3840a73d4", "name": "network-vif-plugged", "status": "completed", "tag": "a3dad938-ab34-4d5f-baea-de05eaf232c6"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:38.596292 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-9fdde160-3576-48c2-8ccc-74cda66ef68a req-428aed54-52e9-4c0b-a7cd-fc769bc1ab69 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.596743 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-9fdde160-3576-48c2-8ccc-74cda66ef68a req-428aed54-52e9-4c0b-a7cd-fc769bc1ab69 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.607754 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-9fdde160-3576-48c2-8ccc-74cda66ef68a req-428aed54-52e9-4c0b-a7cd-fc769bc1ab69 service nova] Creating event network-vif-plugged:a3dad938-ab34-4d5f-baea-de05eaf232c6 for instance 6da53513-cfab-4dee-9c4a-e9f3840a73d4 on hv-cinder-maste Jul 24 01:12:38.613110 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-9fdde160-3576-48c2-8ccc-74cda66ef68a req-428aed54-52e9-4c0b-a7cd-fc769bc1ab69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028552 Jul 24 01:12:38.613751 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 58/119] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:38.927034 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-42243474-3c6b-4de9-96af-0ff1f9e208f9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:38.927594 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-42243474-3c6b-4de9-96af-0ff1f9e208f9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:38.934319 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-42243474-3c6b-4de9-96af-0ff1f9e208f9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.934821 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-42243474-3c6b-4de9-96af-0ff1f9e208f9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.935576 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-42243474-3c6b-4de9-96af-0ff1f9e208f9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.935981 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-42243474-3c6b-4de9-96af-0ff1f9e208f9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.974142 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f6027b72-0fa4-46a6-afec-4504417bfd4a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:38.975664 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f6027b72-0fa4-46a6-afec-4504417bfd4a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:38.982395 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6027b72-0fa4-46a6-afec-4504417bfd4a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.983763 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6027b72-0fa4-46a6-afec-4504417bfd4a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.984574 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6027b72-0fa4-46a6-afec-4504417bfd4a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.985146 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6027b72-0fa4-46a6-afec-4504417bfd4a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.124956 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-42243474-3c6b-4de9-96af-0ff1f9e208f9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:39.133041 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-42243474-3c6b-4de9-96af-0ff1f9e208f9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.209961 Jul 24 01:12:39.133696 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 62/120] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:38 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:39.154658 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f6027b72-0fa4-46a6-afec-4504417bfd4a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:39.162239 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f6027b72-0fa4-46a6-afec-4504417bfd4a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.192342 Jul 24 01:12:39.162816 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 59/121] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:38 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:39.600788 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-026925dc-3b09-45e0-ba5d-bd1742a16a50 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:39.601419 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-026925dc-3b09-45e0-ba5d-bd1742a16a50 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:39.603823 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-86e5b620-ea1a-4617-8354-8fb16b4041b4 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:39.605282 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-86e5b620-ea1a-4617-8354-8fb16b4041b4 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:39.608849 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-026925dc-3b09-45e0-ba5d-bd1742a16a50 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:39.609686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-026925dc-3b09-45e0-ba5d-bd1742a16a50 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.611177 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-026925dc-3b09-45e0-ba5d-bd1742a16a50 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:39.611778 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-026925dc-3b09-45e0-ba5d-bd1742a16a50 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.613400 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-86e5b620-ea1a-4617-8354-8fb16b4041b4 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:39.614087 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-86e5b620-ea1a-4617-8354-8fb16b4041b4 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.614953 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-86e5b620-ea1a-4617-8354-8fb16b4041b4 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:39.615662 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-86e5b620-ea1a-4617-8354-8fb16b4041b4 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.848772 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-86e5b620-ea1a-4617-8354-8fb16b4041b4 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:39.858925 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-026925dc-3b09-45e0-ba5d-bd1742a16a50 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:39.865458 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-86e5b620-ea1a-4617-8354-8fb16b4041b4 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.267669 Jul 24 01:12:39.866943 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-026925dc-3b09-45e0-ba5d-bd1742a16a50 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.270344 Jul 24 01:12:39.867565 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 60/122] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:39 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:39.877164 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 63/123] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:39 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:40.152527 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d6111078-8b91-4aa1-9227-136c4edf12b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:40.153422 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d6111078-8b91-4aa1-9227-136c4edf12b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:40.161794 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d6111078-8b91-4aa1-9227-136c4edf12b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.162415 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d6111078-8b91-4aa1-9227-136c4edf12b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.163379 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d6111078-8b91-4aa1-9227-136c4edf12b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.163863 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d6111078-8b91-4aa1-9227-136c4edf12b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.180187 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6170a9a3-1614-482e-a95d-34cf5954a0b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:40.180887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6170a9a3-1614-482e-a95d-34cf5954a0b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:40.187022 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6170a9a3-1614-482e-a95d-34cf5954a0b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.187580 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6170a9a3-1614-482e-a95d-34cf5954a0b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.188430 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6170a9a3-1614-482e-a95d-34cf5954a0b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.188964 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6170a9a3-1614-482e-a95d-34cf5954a0b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.364819 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d6111078-8b91-4aa1-9227-136c4edf12b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:40.372988 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6170a9a3-1614-482e-a95d-34cf5954a0b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:40.373421 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d6111078-8b91-4aa1-9227-136c4edf12b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.226982 Jul 24 01:12:40.374380 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 61/124] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:40 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:40.389773 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6170a9a3-1614-482e-a95d-34cf5954a0b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.213753 Jul 24 01:12:40.391338 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 64/125] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:40 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:40.632414 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-6bb7b1fa-7c99-4732-82f0-9e9313b9c4c0 req-3808e7cb-5a45-42d2-ba99-e8039a041715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76253536-dc6f-41fe-b9b9-07f62cd2ea50", "name": "network-vif-plugged", "status": "completed", "tag": "1140d1a5-d0e0-4a81-83a0-d2ef896b5b43"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:40.646358 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-6bb7b1fa-7c99-4732-82f0-9e9313b9c4c0 req-3808e7cb-5a45-42d2-ba99-e8039a041715 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.646943 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-6bb7b1fa-7c99-4732-82f0-9e9313b9c4c0 req-3808e7cb-5a45-42d2-ba99-e8039a041715 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.660263 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-6bb7b1fa-7c99-4732-82f0-9e9313b9c4c0 req-3808e7cb-5a45-42d2-ba99-e8039a041715 service nova] Creating event network-vif-plugged:1140d1a5-d0e0-4a81-83a0-d2ef896b5b43 for instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 on hv-cinder-maste Jul 24 01:12:40.665477 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-6bb7b1fa-7c99-4732-82f0-9e9313b9c4c0 req-3808e7cb-5a45-42d2-ba99-e8039a041715 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036679 Jul 24 01:12:40.666099 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 62/126] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:12:40.883817 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a5385f3c-efba-456e-b3cd-c8a8df861db7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:40.884432 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a5385f3c-efba-456e-b3cd-c8a8df861db7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:40.892396 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a5385f3c-efba-456e-b3cd-c8a8df861db7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.892596 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a7bcadd1-e56d-4dfc-9536-11388eae3c56 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:40.893042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a5385f3c-efba-456e-b3cd-c8a8df861db7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.893788 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a7bcadd1-e56d-4dfc-9536-11388eae3c56 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:40.893895 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a5385f3c-efba-456e-b3cd-c8a8df861db7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.894220 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a5385f3c-efba-456e-b3cd-c8a8df861db7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.901634 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a7bcadd1-e56d-4dfc-9536-11388eae3c56 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.902312 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a7bcadd1-e56d-4dfc-9536-11388eae3c56 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.903884 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a7bcadd1-e56d-4dfc-9536-11388eae3c56 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.904527 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a7bcadd1-e56d-4dfc-9536-11388eae3c56 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:41.193707 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a7bcadd1-e56d-4dfc-9536-11388eae3c56 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:41.205455 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a7bcadd1-e56d-4dfc-9536-11388eae3c56 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.316997 Jul 24 01:12:41.207161 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 63/127] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:40 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:41.210818 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a5385f3c-efba-456e-b3cd-c8a8df861db7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:41.220088 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a5385f3c-efba-456e-b3cd-c8a8df861db7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.340338 Jul 24 01:12:41.221312 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 65/128] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:40 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:41.396447 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b10ebce7-0b4f-42f2-b788-5fc49b58dc8c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:41.397369 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b10ebce7-0b4f-42f2-b788-5fc49b58dc8c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:41.410820 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a68b0616-29da-4da3-be6b-b07aec2f2abd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:41.412053 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a68b0616-29da-4da3-be6b-b07aec2f2abd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:41.461459 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b10ebce7-0b4f-42f2-b788-5fc49b58dc8c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:41.464774 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a68b0616-29da-4da3-be6b-b07aec2f2abd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:41.465215 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b10ebce7-0b4f-42f2-b788-5fc49b58dc8c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:41.468768 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a68b0616-29da-4da3-be6b-b07aec2f2abd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:41.469249 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b10ebce7-0b4f-42f2-b788-5fc49b58dc8c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:41.471575 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b10ebce7-0b4f-42f2-b788-5fc49b58dc8c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:41.475850 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a68b0616-29da-4da3-be6b-b07aec2f2abd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:41.476670 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a68b0616-29da-4da3-be6b-b07aec2f2abd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:41.735811 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b10ebce7-0b4f-42f2-b788-5fc49b58dc8c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:41.746423 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b10ebce7-0b4f-42f2-b788-5fc49b58dc8c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.359232 Jul 24 01:12:41.747742 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 64/129] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:41 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:41.783412 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a68b0616-29da-4da3-be6b-b07aec2f2abd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:41.796584 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a68b0616-29da-4da3-be6b-b07aec2f2abd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.388549 Jul 24 01:12:41.797234 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 66/130] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:41 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:42.223970 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-11509ce7-300a-4b2d-8ad9-f8cede5d9e5a tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:42.224824 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-11509ce7-300a-4b2d-8ad9-f8cede5d9e5a tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:42.238961 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f0174c35-cf98-4f85-8cca-0d260ddbe3bc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:42.241019 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f0174c35-cf98-4f85-8cca-0d260ddbe3bc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:42.250244 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f0174c35-cf98-4f85-8cca-0d260ddbe3bc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:42.251870 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-11509ce7-300a-4b2d-8ad9-f8cede5d9e5a tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:42.252522 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-11509ce7-300a-4b2d-8ad9-f8cede5d9e5a tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:42.253182 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f0174c35-cf98-4f85-8cca-0d260ddbe3bc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:42.254604 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-11509ce7-300a-4b2d-8ad9-f8cede5d9e5a tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:42.256748 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f0174c35-cf98-4f85-8cca-0d260ddbe3bc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:42.257551 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-11509ce7-300a-4b2d-8ad9-f8cede5d9e5a tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:42.258467 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f0174c35-cf98-4f85-8cca-0d260ddbe3bc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:42.922404 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f0174c35-cf98-4f85-8cca-0d260ddbe3bc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:42.930288 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f0174c35-cf98-4f85-8cca-0d260ddbe3bc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.697129 Jul 24 01:12:42.940347 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 67/131] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:42 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:42.945515 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6e5ae11f-06ad-47dc-a538-a85df8ecdcd8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:42.946436 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6e5ae11f-06ad-47dc-a538-a85df8ecdcd8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:42.952740 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6e5ae11f-06ad-47dc-a538-a85df8ecdcd8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:42.953477 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6e5ae11f-06ad-47dc-a538-a85df8ecdcd8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:42.954451 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6e5ae11f-06ad-47dc-a538-a85df8ecdcd8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:42.955080 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6e5ae11f-06ad-47dc-a538-a85df8ecdcd8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:42.982050 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-11509ce7-300a-4b2d-8ad9-f8cede5d9e5a tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:42.996865 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-11509ce7-300a-4b2d-8ad9-f8cede5d9e5a tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.776433 Jul 24 01:12:42.998491 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 65/132] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:42 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:43.005190 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-67495f1b-b802-415b-9459-ab56e1fab9da tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:43.006025 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-67495f1b-b802-415b-9459-ab56e1fab9da tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:43.013409 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-67495f1b-b802-415b-9459-ab56e1fab9da tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:43.013916 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-67495f1b-b802-415b-9459-ab56e1fab9da tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:43.014770 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-67495f1b-b802-415b-9459-ab56e1fab9da tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:43.015330 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-67495f1b-b802-415b-9459-ab56e1fab9da tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:43.429571 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6e5ae11f-06ad-47dc-a538-a85df8ecdcd8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:43.445520 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6e5ae11f-06ad-47dc-a538-a85df8ecdcd8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.503770 Jul 24 01:12:43.446381 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 68/133] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:42 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:43.458483 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-67495f1b-b802-415b-9459-ab56e1fab9da tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:43.468703 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-67495f1b-b802-415b-9459-ab56e1fab9da tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.468442 Jul 24 01:12:43.478544 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 66/134] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:42 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:43.948100 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c36c888e-8fe4-468e-ae64-ced46427176d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:43.948712 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c36c888e-8fe4-468e-ae64-ced46427176d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:43.956449 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c36c888e-8fe4-468e-ae64-ced46427176d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:43.957192 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c36c888e-8fe4-468e-ae64-ced46427176d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:43.958105 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c36c888e-8fe4-468e-ae64-ced46427176d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:43.959358 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c36c888e-8fe4-468e-ae64-ced46427176d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:44.015087 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5a7cc367-2fa8-495b-8b3f-b847862ad278 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:44.015729 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-5a7cc367-2fa8-495b-8b3f-b847862ad278 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:44.026145 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a7cc367-2fa8-495b-8b3f-b847862ad278 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:44.026987 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a7cc367-2fa8-495b-8b3f-b847862ad278 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:44.027795 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a7cc367-2fa8-495b-8b3f-b847862ad278 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:44.028227 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a7cc367-2fa8-495b-8b3f-b847862ad278 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:44.233636 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c36c888e-8fe4-468e-ae64-ced46427176d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:44.234070 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-5a7cc367-2fa8-495b-8b3f-b847862ad278 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:44.254166 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5a7cc367-2fa8-495b-8b3f-b847862ad278 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.243306 Jul 24 01:12:44.254986 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c36c888e-8fe4-468e-ae64-ced46427176d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.310807 Jul 24 01:12:44.256189 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 69/135] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:43 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:44.259483 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 67/136] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:44 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:44.462118 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-193d210c-d0ab-4091-aa5f-32d887fcaa90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:44.462730 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-193d210c-d0ab-4091-aa5f-32d887fcaa90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:44.471865 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-193d210c-d0ab-4091-aa5f-32d887fcaa90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:44.472318 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-193d210c-d0ab-4091-aa5f-32d887fcaa90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:44.473087 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-193d210c-d0ab-4091-aa5f-32d887fcaa90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:44.473663 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-193d210c-d0ab-4091-aa5f-32d887fcaa90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:44.485960 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7fb6e50a-86dc-4824-b836-1b328c4c0895 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:44.486905 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7fb6e50a-86dc-4824-b836-1b328c4c0895 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:44.494087 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7fb6e50a-86dc-4824-b836-1b328c4c0895 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:44.494869 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7fb6e50a-86dc-4824-b836-1b328c4c0895 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:44.496426 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7fb6e50a-86dc-4824-b836-1b328c4c0895 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:44.497197 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7fb6e50a-86dc-4824-b836-1b328c4c0895 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:44.748323 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7fb6e50a-86dc-4824-b836-1b328c4c0895 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:44.756698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-193d210c-d0ab-4091-aa5f-32d887fcaa90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:44.757587 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7fb6e50a-86dc-4824-b836-1b328c4c0895 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.275301 Jul 24 01:12:44.758512 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 68/137] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:44 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:44.765032 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-193d210c-d0ab-4091-aa5f-32d887fcaa90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.306873 Jul 24 01:12:44.774503 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 70/138] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:44 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:45.274720 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-999802f3-8910-4371-a48b-4d1335e4ce4a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:45.275162 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8148ab4d-f1ca-44a0-9ac5-7e8c4a4b295c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:45.275662 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-999802f3-8910-4371-a48b-4d1335e4ce4a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:45.276413 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8148ab4d-f1ca-44a0-9ac5-7e8c4a4b295c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:45.283990 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-999802f3-8910-4371-a48b-4d1335e4ce4a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.284677 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-999802f3-8910-4371-a48b-4d1335e4ce4a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:45.285663 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-999802f3-8910-4371-a48b-4d1335e4ce4a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.286558 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-999802f3-8910-4371-a48b-4d1335e4ce4a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:45.292568 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=100 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:45.302653 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8148ab4d-f1ca-44a0-9ac5-7e8c4a4b295c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.303731 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8148ab4d-f1ca-44a0-9ac5-7e8c4a4b295c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:45.304639 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8148ab4d-f1ca-44a0-9ac5-7e8c4a4b295c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.305069 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8148ab4d-f1ca-44a0-9ac5-7e8c4a4b295c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:45.489918 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-999802f3-8910-4371-a48b-4d1335e4ce4a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:45.501478 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-999802f3-8910-4371-a48b-4d1335e4ce4a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.232044 Jul 24 01:12:45.502973 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 71/139] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:45 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:45.573251 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8148ab4d-f1ca-44a0-9ac5-7e8c4a4b295c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:45.582884 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8148ab4d-f1ca-44a0-9ac5-7e8c4a4b295c tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.313054 Jul 24 01:12:45.592358 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 69/140] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:45 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:45.776366 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3485f28a-4fad-4a77-880d-e5762d252e38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:45.777534 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3485f28a-4fad-4a77-880d-e5762d252e38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:45.777889 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-81de8d66-efd9-4192-bf68-1437c0774f5b req-6fa866c3-6baf-44d5-9296-21160ccfdf9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b4f90c-bd24-4e24-9175-7c8bb57f1245", "name": "network-vif-plugged", "status": "completed", "tag": "10d1484e-6736-4cd1-a0dd-fea4d4375bbc"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:45.785507 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=85 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:45.789981 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3485f28a-4fad-4a77-880d-e5762d252e38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.791202 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3485f28a-4fad-4a77-880d-e5762d252e38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:45.793067 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3485f28a-4fad-4a77-880d-e5762d252e38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.797722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-81de8d66-efd9-4192-bf68-1437c0774f5b req-6fa866c3-6baf-44d5-9296-21160ccfdf9d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.797722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-81de8d66-efd9-4192-bf68-1437c0774f5b req-6fa866c3-6baf-44d5-9296-21160ccfdf9d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:45.797934 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3485f28a-4fad-4a77-880d-e5762d252e38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:45.817932 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-81de8d66-efd9-4192-bf68-1437c0774f5b req-6fa866c3-6baf-44d5-9296-21160ccfdf9d service nova] Creating event network-vif-plugged:10d1484e-6736-4cd1-a0dd-fea4d4375bbc for instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 on hv-cinder-maste Jul 24 01:12:45.838458 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-81de8d66-efd9-4192-bf68-1437c0774f5b req-6fa866c3-6baf-44d5-9296-21160ccfdf9d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064224 Jul 24 01:12:45.839059 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 70/141] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:12:45.845523 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c615dbed-6162-4688-bdf9-d8feaa9961dd tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:45.847109 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c615dbed-6162-4688-bdf9-d8feaa9961dd tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:45.855744 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c615dbed-6162-4688-bdf9-d8feaa9961dd tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.856491 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c615dbed-6162-4688-bdf9-d8feaa9961dd tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:45.857485 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c615dbed-6162-4688-bdf9-d8feaa9961dd tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.858145 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c615dbed-6162-4688-bdf9-d8feaa9961dd tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:46.120977 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c615dbed-6162-4688-bdf9-d8feaa9961dd tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:46.123734 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3485f28a-4fad-4a77-880d-e5762d252e38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:46.131903 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3485f28a-4fad-4a77-880d-e5762d252e38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1322 microversion: 2.1 time: 0.360491 Jul 24 01:12:46.141786 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 72/142] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:45 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:46.148179 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c615dbed-6162-4688-bdf9-d8feaa9961dd tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.307652 Jul 24 01:12:46.148949 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:45 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:46.492987 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1476789063", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "networks": [{"uuid": "08bdbcaf-1e45-455a-b2a7-eda9f6215ae3"}]}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:46.526689 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6400c3e1-49e5-47d3-820e-76f049b7f02a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:46.527331 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6400c3e1-49e5-47d3-820e-76f049b7f02a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:46.534762 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6400c3e1-49e5-47d3-820e-76f049b7f02a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:46.535213 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6400c3e1-49e5-47d3-820e-76f049b7f02a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:46.537063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6400c3e1-49e5-47d3-820e-76f049b7f02a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:46.537510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6400c3e1-49e5-47d3-820e-76f049b7f02a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:46.568917 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] validate_networks() for [('08bdbcaf-1e45-455a-b2a7-eda9f6215ae3', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:12:46.579872 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=100 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:46.781502 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6400c3e1-49e5-47d3-820e-76f049b7f02a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:46.788479 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6400c3e1-49e5-47d3-820e-76f049b7f02a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.265341 Jul 24 01:12:46.789180 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 72/144] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:46 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:46.794922 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e80a5564-f901-48e4-9323-fb2c9859ec7f tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:46.802066 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e80a5564-f901-48e4-9323-fb2c9859ec7f tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:46.817015 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e80a5564-f901-48e4-9323-fb2c9859ec7f tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:46.817492 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e80a5564-f901-48e4-9323-fb2c9859ec7f tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:46.818686 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e80a5564-f901-48e4-9323-fb2c9859ec7f tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:46.818769 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e80a5564-f901-48e4-9323-fb2c9859ec7f tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.039641 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e80a5564-f901-48e4-9323-fb2c9859ec7f tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:47.050467 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e80a5564-f901-48e4-9323-fb2c9859ec7f tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1315 microversion: 2.1 time: 0.259843 Jul 24 01:12:47.051049 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 73/145] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:46 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:47.138998 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:12:47.139717 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:12:47.140184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:12:47.140584 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:12:47.140988 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:12:47.151109 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.151961 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-556af1c2-abee-45da-80f4-06d230dc0551 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:47.152725 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.153567 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-556af1c2-abee-45da-80f4-06d230dc0551 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:47.154020 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.154894 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.179844 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Getting quotas for project b8d043fc94e647b5864b2d44ae419fa5. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:47.181626 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-556af1c2-abee-45da-80f4-06d230dc0551 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.183586 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-556af1c2-abee-45da-80f4-06d230dc0551 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.184939 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-556af1c2-abee-45da-80f4-06d230dc0551 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.185381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-556af1c2-abee-45da-80f4-06d230dc0551 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.188803 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Getting quotas for user b9e9ac94e391429887296c4da62f30b5 and project b8d043fc94e647b5864b2d44ae419fa5. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:47.211239 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:12:47.215230 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:12:47.301323 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ea7588b8-19a9-4453-ac7f-f4f968026eed tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.158058 Jul 24 01:12:47.302356 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 73/146] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:12:47.310404 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d585894c-e8cd-431b-8fc3-f4499cd50745 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:47.311491 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d585894c-e8cd-431b-8fc3-f4499cd50745 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:47.329541 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d585894c-e8cd-431b-8fc3-f4499cd50745 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.329985 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d585894c-e8cd-431b-8fc3-f4499cd50745 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.332172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d585894c-e8cd-431b-8fc3-f4499cd50745 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.332606 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d585894c-e8cd-431b-8fc3-f4499cd50745 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.374069 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-556af1c2-abee-45da-80f4-06d230dc0551 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:47.385613 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-556af1c2-abee-45da-80f4-06d230dc0551 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1516 microversion: 2.1 time: 0.239684 Jul 24 01:12:47.386220 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 74/147] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:47 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1516 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:47.391105 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8e241150-a4da-495e-9200-9e0cdc8a7710 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:47.391929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8e241150-a4da-495e-9200-9e0cdc8a7710 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:47.453256 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8e241150-a4da-495e-9200-9e0cdc8a7710 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:47.461364 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8e241150-a4da-495e-9200-9e0cdc8a7710 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1214 microversion: 2.1 time: 0.073798 Jul 24 01:12:47.462311 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 75/148] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:47 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:47.483227 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d979b103-d897-4de0-8158-7b68dd81065c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:47.485825 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d979b103-d897-4de0-8158-7b68dd81065c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:47.492992 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d979b103-d897-4de0-8158-7b68dd81065c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.493622 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d979b103-d897-4de0-8158-7b68dd81065c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.494584 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d979b103-d897-4de0-8158-7b68dd81065c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.495323 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d979b103-d897-4de0-8158-7b68dd81065c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.521317 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d585894c-e8cd-431b-8fc3-f4499cd50745 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:47.532190 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d585894c-e8cd-431b-8fc3-f4499cd50745 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.228119 Jul 24 01:12:47.542915 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 74/149] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:47 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:47.570978 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-d979b103-d897-4de0-8158-7b68dd81065c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lazy-loading 'flavor' on Instance uuid 6da53513-cfab-4dee-9c4a-e9f3840a73d4 {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:47.708939 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d979b103-d897-4de0-8158-7b68dd81065c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4/action" status: 200 len: 32 microversion: 2.1 time: 0.234879 Jul 24 01:12:47.708939 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 76/150] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:12:47 2022] POST /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4/action => generated 32 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:12:47.719104 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-78ed8bef-c170-462b-80c1-98872471c6ac tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:47.719877 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-78ed8bef-c170-462b-80c1-98872471c6ac tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:47.726401 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-78ed8bef-c170-462b-80c1-98872471c6ac tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.727329 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-78ed8bef-c170-462b-80c1-98872471c6ac tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.728610 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-78ed8bef-c170-462b-80c1-98872471c6ac tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.730777 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-78ed8bef-c170-462b-80c1-98872471c6ac tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.807714 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-59063803-e869-4d42-af11-a19975462053 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:47.818474 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-59063803-e869-4d42-af11-a19975462053 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:47.827200 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-59063803-e869-4d42-af11-a19975462053 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.829014 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-59063803-e869-4d42-af11-a19975462053 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.830465 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-59063803-e869-4d42-af11-a19975462053 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.831412 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-59063803-e869-4d42-af11-a19975462053 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.914161 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-78ed8bef-c170-462b-80c1-98872471c6ac tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:47.923415 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-78ed8bef-c170-462b-80c1-98872471c6ac tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.208501 Jul 24 01:12:47.933737 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 75/151] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:47 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:47.939230 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-0a419231-484b-4e13-a7bf-2ceaf419a24e req-52ebb279-975a-41ee-b3b5-71be95acdd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c12186-86f3-4887-9e0a-ed1b48f307ba", "name": "network-vif-plugged", "status": "completed", "tag": "d85b179a-7a05-4ea4-8139-bc1c8fc67296"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:47.949271 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0a419231-484b-4e13-a7bf-2ceaf419a24e req-52ebb279-975a-41ee-b3b5-71be95acdd54 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.949891 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0a419231-484b-4e13-a7bf-2ceaf419a24e req-52ebb279-975a-41ee-b3b5-71be95acdd54 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.964409 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-0a419231-484b-4e13-a7bf-2ceaf419a24e req-52ebb279-975a-41ee-b3b5-71be95acdd54 service nova] Creating event network-vif-plugged:d85b179a-7a05-4ea4-8139-bc1c8fc67296 for instance 76c12186-86f3-4887-9e0a-ed1b48f307ba on hv-cinder-maste Jul 24 01:12:47.969751 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-0a419231-484b-4e13-a7bf-2ceaf419a24e req-52ebb279-975a-41ee-b3b5-71be95acdd54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043556 Jul 24 01:12:47.970351 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 76/152] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:47.986847 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-59063803-e869-4d42-af11-a19975462053 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:47.994469 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-59063803-e869-4d42-af11-a19975462053 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.192434 Jul 24 01:12:47.995050 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 77/153] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:47 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:48.073978 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-94b69f03-4bf5-4fb8-aa14-306be99bc05e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:48.076192 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-94b69f03-4bf5-4fb8-aa14-306be99bc05e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:48.090373 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-94b69f03-4bf5-4fb8-aa14-306be99bc05e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.090940 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-94b69f03-4bf5-4fb8-aa14-306be99bc05e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.091856 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-94b69f03-4bf5-4fb8-aa14-306be99bc05e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.092373 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-94b69f03-4bf5-4fb8-aa14-306be99bc05e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.243909 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-94b69f03-4bf5-4fb8-aa14-306be99bc05e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:48.268865 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-94b69f03-4bf5-4fb8-aa14-306be99bc05e tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1502 microversion: 2.1 time: 0.204499 Jul 24 01:12:48.282456 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 77/154] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:48 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:48.487824 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ea9d8069-c240-46ec-ac11-3b0b241e3bbf tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:48.488543 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ea9d8069-c240-46ec-ac11-3b0b241e3bbf tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:48.501157 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ea9d8069-c240-46ec-ac11-3b0b241e3bbf tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.501527 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ea9d8069-c240-46ec-ac11-3b0b241e3bbf tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.502311 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ea9d8069-c240-46ec-ac11-3b0b241e3bbf tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.507059 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ea9d8069-c240-46ec-ac11-3b0b241e3bbf tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.561298 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ea37d0e9-2f6f-42a0-80b6-3186ce8f722f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:48.562461 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ea37d0e9-2f6f-42a0-80b6-3186ce8f722f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:48.570746 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ea37d0e9-2f6f-42a0-80b6-3186ce8f722f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.571388 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ea37d0e9-2f6f-42a0-80b6-3186ce8f722f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.572395 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ea37d0e9-2f6f-42a0-80b6-3186ce8f722f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.573019 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ea37d0e9-2f6f-42a0-80b6-3186ce8f722f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.606261 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ea9d8069-c240-46ec-ac11-3b0b241e3bbf tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:48.617185 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ea9d8069-c240-46ec-ac11-3b0b241e3bbf tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1218 microversion: 2.1 time: 0.138383 Jul 24 01:12:48.618139 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 78/155] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:48 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:48.818301 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ea37d0e9-2f6f-42a0-80b6-3186ce8f722f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:48.837441 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ea37d0e9-2f6f-42a0-80b6-3186ce8f722f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.279164 Jul 24 01:12:48.838565 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 78/156] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:48 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:48.943059 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e1acd419-28d1-4aac-9821-301fb058097f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:48.943559 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e1acd419-28d1-4aac-9821-301fb058097f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:48.974155 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e1acd419-28d1-4aac-9821-301fb058097f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.975232 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e1acd419-28d1-4aac-9821-301fb058097f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.976503 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e1acd419-28d1-4aac-9821-301fb058097f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.982190 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e1acd419-28d1-4aac-9821-301fb058097f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.018821 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3034fa4a-c983-4cbc-8bd6-325817a94677 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:49.019582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3034fa4a-c983-4cbc-8bd6-325817a94677 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:49.029010 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3034fa4a-c983-4cbc-8bd6-325817a94677 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.029729 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3034fa4a-c983-4cbc-8bd6-325817a94677 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.030749 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3034fa4a-c983-4cbc-8bd6-325817a94677 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.032554 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3034fa4a-c983-4cbc-8bd6-325817a94677 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.345523 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3034fa4a-c983-4cbc-8bd6-325817a94677 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:49.355742 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e1acd419-28d1-4aac-9821-301fb058097f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:49.358598 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3034fa4a-c983-4cbc-8bd6-325817a94677 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.348573 Jul 24 01:12:49.359503 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 79/157] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:49 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:49.370233 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e1acd419-28d1-4aac-9821-301fb058097f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.432575 Jul 24 01:12:49.370800 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 79/158] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:48 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:49.635036 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-99bd9e74-0a17-4812-813c-2f7defcc2826 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:49.635972 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-99bd9e74-0a17-4812-813c-2f7defcc2826 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:49.642508 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-99bd9e74-0a17-4812-813c-2f7defcc2826 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.642635 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-99bd9e74-0a17-4812-813c-2f7defcc2826 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.643334 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-99bd9e74-0a17-4812-813c-2f7defcc2826 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.643811 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-99bd9e74-0a17-4812-813c-2f7defcc2826 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.716139 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-99bd9e74-0a17-4812-813c-2f7defcc2826 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:49.725118 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-99bd9e74-0a17-4812-813c-2f7defcc2826 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1210 microversion: 2.1 time: 0.094204 Jul 24 01:12:49.735622 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 80/159] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:49 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:49.813183 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-da559368-d147-49e8-8699-de528b5de594 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82630b4a-7239-4f71-afff-5f0780902b97"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:49.814305 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-da559368-d147-49e8-8699-de528b5de594 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:49.833000 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-da559368-d147-49e8-8699-de528b5de594 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.833442 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-da559368-d147-49e8-8699-de528b5de594 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.834208 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-da559368-d147-49e8-8699-de528b5de594 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.834638 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-da559368-d147-49e8-8699-de528b5de594 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.855169 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2eb1344b-2a50-4e99-b40f-4730fc81f290 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:49.855911 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2eb1344b-2a50-4e99-b40f-4730fc81f290 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:49.866417 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2eb1344b-2a50-4e99-b40f-4730fc81f290 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.870432 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2eb1344b-2a50-4e99-b40f-4730fc81f290 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.871423 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2eb1344b-2a50-4e99-b40f-4730fc81f290 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.871945 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2eb1344b-2a50-4e99-b40f-4730fc81f290 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:50.071840 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2eb1344b-2a50-4e99-b40f-4730fc81f290 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:50.081911 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2eb1344b-2a50-4e99-b40f-4730fc81f290 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1367 microversion: 2.1 time: 0.230711 Jul 24 01:12:50.082808 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 81/160] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:49 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:50.375891 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-cb687d25-44d2-433c-8995-b9ee91a4b4a6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:50.377344 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-cb687d25-44d2-433c-8995-b9ee91a4b4a6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:50.384879 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb687d25-44d2-433c-8995-b9ee91a4b4a6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:50.385624 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb687d25-44d2-433c-8995-b9ee91a4b4a6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:50.386650 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb687d25-44d2-433c-8995-b9ee91a4b4a6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:50.387256 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb687d25-44d2-433c-8995-b9ee91a4b4a6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:50.528171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cb687d25-44d2-433c-8995-b9ee91a4b4a6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:50.535936 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-cb687d25-44d2-433c-8995-b9ee91a4b4a6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.163953 Jul 24 01:12:50.536509 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 82/161] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:50 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:50.541221 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4806048e-53f1-48fd-add8-cb5e17ad79cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:50.541824 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4806048e-53f1-48fd-add8-cb5e17ad79cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:50.547686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4806048e-53f1-48fd-add8-cb5e17ad79cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:50.548135 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4806048e-53f1-48fd-add8-cb5e17ad79cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:50.548888 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4806048e-53f1-48fd-add8-cb5e17ad79cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:50.549507 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4806048e-53f1-48fd-add8-cb5e17ad79cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:50.741949 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4806048e-53f1-48fd-add8-cb5e17ad79cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:50.751622 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4806048e-53f1-48fd-add8-cb5e17ad79cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.213850 Jul 24 01:12:50.752345 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 83/162] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:50 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:50.758549 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4060d08d-cf1c-4958-82eb-9dc058baaa29 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:50.759386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4060d08d-cf1c-4958-82eb-9dc058baaa29 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:50.784054 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4060d08d-cf1c-4958-82eb-9dc058baaa29 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:50.784515 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4060d08d-cf1c-4958-82eb-9dc058baaa29 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:50.787893 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4060d08d-cf1c-4958-82eb-9dc058baaa29 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:50.788408 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4060d08d-cf1c-4958-82eb-9dc058baaa29 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:50.877092 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4060d08d-cf1c-4958-82eb-9dc058baaa29 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:50.884740 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4060d08d-cf1c-4958-82eb-9dc058baaa29 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1266 microversion: 2.1 time: 0.131413 Jul 24 01:12:50.885348 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 84/163] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:50 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:51.101145 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d33dd8c9-c931-4e11-a674-4c8ed6860a5b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:51.102121 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d33dd8c9-c931-4e11-a674-4c8ed6860a5b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:51.126737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d33dd8c9-c931-4e11-a674-4c8ed6860a5b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:51.127186 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d33dd8c9-c931-4e11-a674-4c8ed6860a5b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:51.127997 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d33dd8c9-c931-4e11-a674-4c8ed6860a5b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:51.132639 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d33dd8c9-c931-4e11-a674-4c8ed6860a5b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:51.400178 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d33dd8c9-c931-4e11-a674-4c8ed6860a5b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:51.409735 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d33dd8c9-c931-4e11-a674-4c8ed6860a5b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1557 microversion: 2.1 time: 0.313462 Jul 24 01:12:51.410321 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 85/164] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:51 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1557 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:51.426982 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-847f106a-ab29-4286-a4c9-7366f137cc1d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:51.427784 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-847f106a-ab29-4286-a4c9-7366f137cc1d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:51.438454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-847f106a-ab29-4286-a4c9-7366f137cc1d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:51.438454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-847f106a-ab29-4286-a4c9-7366f137cc1d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:51.438454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-847f106a-ab29-4286-a4c9-7366f137cc1d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:51.438454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-847f106a-ab29-4286-a4c9-7366f137cc1d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:51.584604 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-847f106a-ab29-4286-a4c9-7366f137cc1d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161372 Jul 24 01:12:51.585430 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 86/165] 10.222.0.42 () {58 vars in 1274 bytes} [Sun Jul 24 01:12:51 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:12:51.597789 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-136fff14-088f-425f-82ac-fe93c1989006 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:51.599696 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-136fff14-088f-425f-82ac-fe93c1989006 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:51.609800 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-136fff14-088f-425f-82ac-fe93c1989006 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:51.610319 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-136fff14-088f-425f-82ac-fe93c1989006 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:51.611363 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-136fff14-088f-425f-82ac-fe93c1989006 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:51.611822 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-136fff14-088f-425f-82ac-fe93c1989006 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.131894 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-136fff14-088f-425f-82ac-fe93c1989006 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:52.140707 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-136fff14-088f-425f-82ac-fe93c1989006 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1364 microversion: 2.1 time: 0.554245 Jul 24 01:12:52.183696 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 87/166] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:51 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:52.194876 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6d594085-ca43-4431-aba4-9f7992270e1d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:52.195532 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6d594085-ca43-4431-aba4-9f7992270e1d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:52.214102 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6d594085-ca43-4431-aba4-9f7992270e1d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.214558 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6d594085-ca43-4431-aba4-9f7992270e1d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.215426 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6d594085-ca43-4431-aba4-9f7992270e1d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.215780 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6d594085-ca43-4431-aba4-9f7992270e1d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.497031 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-da559368-d147-49e8-8699-de528b5de594 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "POST /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.687816 Jul 24 01:12:52.501501 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 80/167] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:12:49 2022] POST /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50/os-volume_attachments => generated 194 bytes in 2693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:52.512408 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d5e5b4ea-46fb-49cd-a957-7395d6f8cf86 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:52.514322 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d5e5b4ea-46fb-49cd-a957-7395d6f8cf86 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:52.524423 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5e5b4ea-46fb-49cd-a957-7395d6f8cf86 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.530062 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5e5b4ea-46fb-49cd-a957-7395d6f8cf86 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.530975 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5e5b4ea-46fb-49cd-a957-7395d6f8cf86 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.531544 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5e5b4ea-46fb-49cd-a957-7395d6f8cf86 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.532655 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6d594085-ca43-4431-aba4-9f7992270e1d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:52.541930 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6d594085-ca43-4431-aba4-9f7992270e1d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.354161 Jul 24 01:12:52.545968 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 88/168] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:52 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:52.849921 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d5e5b4ea-46fb-49cd-a957-7395d6f8cf86 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:52.860619 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d5e5b4ea-46fb-49cd-a957-7395d6f8cf86 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1266 microversion: 2.1 time: 0.357246 Jul 24 01:12:52.861445 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 81/169] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:52 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:53.191732 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4c514d13-6a8b-4589-b894-77387d0eae92 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:53.192344 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4c514d13-6a8b-4589-b894-77387d0eae92 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:53.214072 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c514d13-6a8b-4589-b894-77387d0eae92 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:53.214518 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c514d13-6a8b-4589-b894-77387d0eae92 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:53.215388 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c514d13-6a8b-4589-b894-77387d0eae92 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:53.215820 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c514d13-6a8b-4589-b894-77387d0eae92 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:53.258537 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=100 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:53.560150 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4c514d13-6a8b-4589-b894-77387d0eae92 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:53.564123 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-92eb4cff-c899-44aa-be25-5668d4a64562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:53.566630 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-92eb4cff-c899-44aa-be25-5668d4a64562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:53.577439 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4c514d13-6a8b-4589-b894-77387d0eae92 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1550 microversion: 2.1 time: 0.391046 Jul 24 01:12:53.583386 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 89/170] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:53 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1550 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:53.588828 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-92eb4cff-c899-44aa-be25-5668d4a64562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:53.589575 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-92eb4cff-c899-44aa-be25-5668d4a64562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:53.594181 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-92eb4cff-c899-44aa-be25-5668d4a64562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:53.595389 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-92eb4cff-c899-44aa-be25-5668d4a64562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:53.599906 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-15bdba78-b3da-4b1b-8e2b-cdf4f37018bf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:53.600466 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-15bdba78-b3da-4b1b-8e2b-cdf4f37018bf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:53.626759 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-15bdba78-b3da-4b1b-8e2b-cdf4f37018bf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:53.627211 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-15bdba78-b3da-4b1b-8e2b-cdf4f37018bf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:53.641404 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-15bdba78-b3da-4b1b-8e2b-cdf4f37018bf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:53.642371 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-15bdba78-b3da-4b1b-8e2b-cdf4f37018bf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:54.247840 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-15bdba78-b3da-4b1b-8e2b-cdf4f37018bf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.654495 Jul 24 01:12:54.249201 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 90/171] 10.222.0.42 () {58 vars in 1274 bytes} [Sun Jul 24 01:12:53 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/os-interface => generated 285 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:12:54.260243 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7cad598b-682f-403c-b6b6-979a9b2d7484 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:54.261041 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7cad598b-682f-403c-b6b6-979a9b2d7484 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:54.268131 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7cad598b-682f-403c-b6b6-979a9b2d7484 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:54.268898 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7cad598b-682f-403c-b6b6-979a9b2d7484 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:54.269827 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7cad598b-682f-403c-b6b6-979a9b2d7484 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:54.270552 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7cad598b-682f-403c-b6b6-979a9b2d7484 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:54.381554 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7cad598b-682f-403c-b6b6-979a9b2d7484 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:54.387994 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-92eb4cff-c899-44aa-be25-5668d4a64562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:54.395843 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-92eb4cff-c899-44aa-be25-5668d4a64562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.837313 Jul 24 01:12:54.396240 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7cad598b-682f-403c-b6b6-979a9b2d7484 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1272 microversion: 2.1 time: 0.139770 Jul 24 01:12:54.398706 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 91/172] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:54 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:54.399837 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 82/173] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:53 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:54.530529 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-4c5ae72d-ae35-4362-99d3-039705e37539 req-cc1ad98e-5268-4d81-b1bf-ea9c8f5ebb0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b4f90c-bd24-4e24-9175-7c8bb57f1245", "tag": "10d1484e-6736-4cd1-a0dd-fea4d4375bbc"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:54.544250 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-4c5ae72d-ae35-4362-99d3-039705e37539 req-cc1ad98e-5268-4d81-b1bf-ea9c8f5ebb0a service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:54.544744 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-4c5ae72d-ae35-4362-99d3-039705e37539 req-cc1ad98e-5268-4d81-b1bf-ea9c8f5ebb0a service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:54.562475 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-4c5ae72d-ae35-4362-99d3-039705e37539 req-cc1ad98e-5268-4d81-b1bf-ea9c8f5ebb0a service nova] Creating event network-changed:10d1484e-6736-4cd1-a0dd-fea4d4375bbc for instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 on hv-cinder-maste Jul 24 01:12:54.570077 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-4c5ae72d-ae35-4362-99d3-039705e37539 req-cc1ad98e-5268-4d81-b1bf-ea9c8f5ebb0a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047825 Jul 24 01:12:54.570893 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 92/174] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:55.415624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3a722cb3-6a9f-4e69-ac80-8dad0e4c6877 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:55.416238 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3a722cb3-6a9f-4e69-ac80-8dad0e4c6877 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:55.424167 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1a5f0892-7db5-4524-a4cc-eff938f611d9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:55.425009 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1a5f0892-7db5-4524-a4cc-eff938f611d9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:55.446583 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3a722cb3-6a9f-4e69-ac80-8dad0e4c6877 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:55.447027 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3a722cb3-6a9f-4e69-ac80-8dad0e4c6877 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:55.447476 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1a5f0892-7db5-4524-a4cc-eff938f611d9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:55.448178 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1a5f0892-7db5-4524-a4cc-eff938f611d9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:55.449157 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1a5f0892-7db5-4524-a4cc-eff938f611d9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:55.449729 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1a5f0892-7db5-4524-a4cc-eff938f611d9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:55.450716 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3a722cb3-6a9f-4e69-ac80-8dad0e4c6877 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:55.454135 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3a722cb3-6a9f-4e69-ac80-8dad0e4c6877 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:55.703043 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3a722cb3-6a9f-4e69-ac80-8dad0e4c6877 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:55.714837 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3a722cb3-6a9f-4e69-ac80-8dad0e4c6877 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1272 microversion: 2.1 time: 0.303805 Jul 24 01:12:55.716841 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 83/175] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:55 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:55.914908 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1a5f0892-7db5-4524-a4cc-eff938f611d9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:55.922718 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1a5f0892-7db5-4524-a4cc-eff938f611d9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.502655 Jul 24 01:12:55.923325 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 93/176] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:55 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:56.735809 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9e1bf66d-87a9-442c-8d94-f190b01117ee tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:56.736510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9e1bf66d-87a9-442c-8d94-f190b01117ee tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:56.739266 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=94 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:56.744890 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9e1bf66d-87a9-442c-8d94-f190b01117ee tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:56.745339 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9e1bf66d-87a9-442c-8d94-f190b01117ee tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:56.746267 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9e1bf66d-87a9-442c-8d94-f190b01117ee tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:56.746706 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9e1bf66d-87a9-442c-8d94-f190b01117ee tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:56.943373 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b30aec29-8547-4caf-8f13-aa8d1eadd292 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:56.943986 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b30aec29-8547-4caf-8f13-aa8d1eadd292 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:56.950345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b30aec29-8547-4caf-8f13-aa8d1eadd292 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:56.950792 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b30aec29-8547-4caf-8f13-aa8d1eadd292 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:56.951578 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b30aec29-8547-4caf-8f13-aa8d1eadd292 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:56.952339 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b30aec29-8547-4caf-8f13-aa8d1eadd292 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:57.062615 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9e1bf66d-87a9-442c-8d94-f190b01117ee tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:57.072178 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9e1bf66d-87a9-442c-8d94-f190b01117ee tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.342734 Jul 24 01:12:57.076710 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 84/177] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:56 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:57.163607 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:57.201508 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=6 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:57.328374 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-ab8442a3-8af0-4adb-be45-fe747963b302 req-74e5b450-d878-4a01-83e1-5d3032b0779d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c12186-86f3-4887-9e0a-ed1b48f307ba", "tag": "d85b179a-7a05-4ea4-8139-bc1c8fc67296"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:57.338212 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ab8442a3-8af0-4adb-be45-fe747963b302 req-74e5b450-d878-4a01-83e1-5d3032b0779d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:57.338655 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ab8442a3-8af0-4adb-be45-fe747963b302 req-74e5b450-d878-4a01-83e1-5d3032b0779d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:57.415187 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-ab8442a3-8af0-4adb-be45-fe747963b302 req-74e5b450-d878-4a01-83e1-5d3032b0779d service nova] Creating event network-changed:d85b179a-7a05-4ea4-8139-bc1c8fc67296 for instance 76c12186-86f3-4887-9e0a-ed1b48f307ba on hv-cinder-maste Jul 24 01:12:57.432480 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-ab8442a3-8af0-4adb-be45-fe747963b302 req-74e5b450-d878-4a01-83e1-5d3032b0779d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108130 Jul 24 01:12:57.433402 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 85/178] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:57.443810 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4913951d-b9ca-4be3-9a73-272718f93f94 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:57.447672 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4913951d-b9ca-4be3-9a73-272718f93f94 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:57.460139 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:57.467745 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4913951d-b9ca-4be3-9a73-272718f93f94 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:57.468445 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4913951d-b9ca-4be3-9a73-272718f93f94 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:57.469407 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4913951d-b9ca-4be3-9a73-272718f93f94 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:57.472293 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4913951d-b9ca-4be3-9a73-272718f93f94 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:57.540860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4913951d-b9ca-4be3-9a73-272718f93f94 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:12:57.589132 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:57.726012 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4913951d-b9ca-4be3-9a73-272718f93f94 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "DELETE /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 204 len: 0 microversion: 2.1 time: 0.290801 Jul 24 01:12:57.726648 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 86/179] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:57 2022] DELETE /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:57.736990 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-62061fa7-2019-491b-9c9c-a88097446bed tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:57.738622 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-62061fa7-2019-491b-9c9c-a88097446bed tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:57.754270 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-62061fa7-2019-491b-9c9c-a88097446bed tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:57.757159 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-62061fa7-2019-491b-9c9c-a88097446bed tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:57.759378 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-62061fa7-2019-491b-9c9c-a88097446bed tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:57.759792 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-62061fa7-2019-491b-9c9c-a88097446bed tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:57.904502 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b30aec29-8547-4caf-8f13-aa8d1eadd292 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:57.918228 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b30aec29-8547-4caf-8f13-aa8d1eadd292 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.977059 Jul 24 01:12:57.920818 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 94/180] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:56 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:58.092968 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e4ad13f2-d178-4def-bef3-3511791061a2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:58.095940 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e4ad13f2-d178-4def-bef3-3511791061a2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:58.110171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e4ad13f2-d178-4def-bef3-3511791061a2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.111405 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e4ad13f2-d178-4def-bef3-3511791061a2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:58.112514 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e4ad13f2-d178-4def-bef3-3511791061a2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.113161 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e4ad13f2-d178-4def-bef3-3511791061a2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:58.329671 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-62061fa7-2019-491b-9c9c-a88097446bed tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:58.345861 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-62061fa7-2019-491b-9c9c-a88097446bed tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1554 microversion: 2.1 time: 0.611808 Jul 24 01:12:58.346404 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 87/181] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:57 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1554 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:58.463776 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e4ad13f2-d178-4def-bef3-3511791061a2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:58.472722 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e4ad13f2-d178-4def-bef3-3511791061a2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.386420 Jul 24 01:12:58.476210 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 95/182] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:58 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:58.937877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-cc9abd61-1cb4-4858-ad81-cab1faac7ef6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:58.939481 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-cc9abd61-1cb4-4858-ad81-cab1faac7ef6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:58.963911 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cc9abd61-1cb4-4858-ad81-cab1faac7ef6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.964364 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cc9abd61-1cb4-4858-ad81-cab1faac7ef6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:58.965151 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cc9abd61-1cb4-4858-ad81-cab1faac7ef6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.965586 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cc9abd61-1cb4-4858-ad81-cab1faac7ef6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:59.181966 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-cc9abd61-1cb4-4858-ad81-cab1faac7ef6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:59.191235 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-cc9abd61-1cb4-4858-ad81-cab1faac7ef6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.257801 Jul 24 01:12:59.192967 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 88/183] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:58 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:59.363668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f40efeaa-d12d-45a6-910d-45335c22c1e7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:59.364933 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f40efeaa-d12d-45a6-910d-45335c22c1e7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:59.372022 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f40efeaa-d12d-45a6-910d-45335c22c1e7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:59.372645 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f40efeaa-d12d-45a6-910d-45335c22c1e7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:59.373579 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f40efeaa-d12d-45a6-910d-45335c22c1e7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:59.374001 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f40efeaa-d12d-45a6-910d-45335c22c1e7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:59.465323 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-d8d4b2d2-2446-459a-8819-453cc0ed2c94 req-61464659-a7d2-4b00-8ff1-960d818a0a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9afe68-ce8f-45f0-8f35-aa5e752a77d2", "tag": "9ed9cc10-e24b-46c5-b4b7-2c23c5e2258c"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:59.480896 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-d8d4b2d2-2446-459a-8819-453cc0ed2c94 req-61464659-a7d2-4b00-8ff1-960d818a0a7f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:59.481424 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-d8d4b2d2-2446-459a-8819-453cc0ed2c94 req-61464659-a7d2-4b00-8ff1-960d818a0a7f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:59.493140 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-d8d4b2d2-2446-459a-8819-453cc0ed2c94 req-61464659-a7d2-4b00-8ff1-960d818a0a7f service nova] Creating event network-changed:9ed9cc10-e24b-46c5-b4b7-2c23c5e2258c for instance aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 on hv-cinder-maste Jul 24 01:12:59.498310 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-d8d4b2d2-2446-459a-8819-453cc0ed2c94 req-61464659-a7d2-4b00-8ff1-960d818a0a7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036864 Jul 24 01:12:59.499547 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 89/184] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:59.505747 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a73036ce-b161-4174-9f25-fbfc26cd227e tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:59.506567 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a73036ce-b161-4174-9f25-fbfc26cd227e tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:59.524357 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a73036ce-b161-4174-9f25-fbfc26cd227e tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:59.551087 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a73036ce-b161-4174-9f25-fbfc26cd227e tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:59.557791 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a73036ce-b161-4174-9f25-fbfc26cd227e tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:59.558254 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a73036ce-b161-4174-9f25-fbfc26cd227e tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:59.855102 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f40efeaa-d12d-45a6-910d-45335c22c1e7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:59.871527 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f40efeaa-d12d-45a6-910d-45335c22c1e7 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1554 microversion: 2.1 time: 0.511780 Jul 24 01:12:59.881698 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 96/185] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:59 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1554 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:59.942464 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a73036ce-b161-4174-9f25-fbfc26cd227e tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:59.951755 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a73036ce-b161-4174-9f25-fbfc26cd227e tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.450675 Jul 24 01:12:59.952332 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 90/186] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:59 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:00.209446 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f270f649-d9bb-46ca-ab29-35460c1cb313 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:00.211126 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f270f649-d9bb-46ca-ab29-35460c1cb313 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:00.221647 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f270f649-d9bb-46ca-ab29-35460c1cb313 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:00.222093 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f270f649-d9bb-46ca-ab29-35460c1cb313 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:00.229053 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f270f649-d9bb-46ca-ab29-35460c1cb313 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:00.230179 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f270f649-d9bb-46ca-ab29-35460c1cb313 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:00.405725 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f270f649-d9bb-46ca-ab29-35460c1cb313 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:00.418472 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f270f649-d9bb-46ca-ab29-35460c1cb313 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.213052 Jul 24 01:13:00.423459 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 97/187] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:00 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:00.890493 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6a1b0646-af5b-435b-99c0-62a3fe0fd352 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:00.891120 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6a1b0646-af5b-435b-99c0-62a3fe0fd352 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:00.899818 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6a1b0646-af5b-435b-99c0-62a3fe0fd352 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:00.900207 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6a1b0646-af5b-435b-99c0-62a3fe0fd352 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:00.900980 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6a1b0646-af5b-435b-99c0-62a3fe0fd352 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:00.901407 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6a1b0646-af5b-435b-99c0-62a3fe0fd352 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:00.980646 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2895e14d-0d18-408f-9e5b-c3e9533f2795 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:00.981280 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2895e14d-0d18-408f-9e5b-c3e9533f2795 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:00.994236 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2895e14d-0d18-408f-9e5b-c3e9533f2795 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:00.994695 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2895e14d-0d18-408f-9e5b-c3e9533f2795 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:01.007691 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2895e14d-0d18-408f-9e5b-c3e9533f2795 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:01.008633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2895e14d-0d18-408f-9e5b-c3e9533f2795 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:01.338194 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6a1b0646-af5b-435b-99c0-62a3fe0fd352 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:01.349913 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6a1b0646-af5b-435b-99c0-62a3fe0fd352 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1554 microversion: 2.1 time: 0.465073 Jul 24 01:13:01.351468 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 91/188] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:00 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1554 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:01.436608 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d4885657-b92c-46c9-bc0a-6ecc25b603aa tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:01.437813 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d4885657-b92c-46c9-bc0a-6ecc25b603aa tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:01.448535 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4885657-b92c-46c9-bc0a-6ecc25b603aa tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:01.448977 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2895e14d-0d18-408f-9e5b-c3e9533f2795 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:01.451763 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4885657-b92c-46c9-bc0a-6ecc25b603aa tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:01.452582 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4885657-b92c-46c9-bc0a-6ecc25b603aa tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:01.453184 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4885657-b92c-46c9-bc0a-6ecc25b603aa tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:01.464014 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2895e14d-0d18-408f-9e5b-c3e9533f2795 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.497797 Jul 24 01:13:01.465421 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 98/189] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:00 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:02.013109 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-1e8c46f9-1feb-4398-b998-f303a45d8a41 req-bdeec435-e3b4-427f-934f-9892edbbcf4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76253536-dc6f-41fe-b9b9-07f62cd2ea50", "name": "network-vif-deleted", "tag": "1140d1a5-d0e0-4a81-83a0-d2ef896b5b43"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:02.016134 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d4885657-b92c-46c9-bc0a-6ecc25b603aa tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:02.024293 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-1e8c46f9-1feb-4398-b998-f303a45d8a41 req-bdeec435-e3b4-427f-934f-9892edbbcf4d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:02.024726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-1e8c46f9-1feb-4398-b998-f303a45d8a41 req-bdeec435-e3b4-427f-934f-9892edbbcf4d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:02.027857 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d4885657-b92c-46c9-bc0a-6ecc25b603aa tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.595443 Jul 24 01:13:02.028463 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 92/190] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:01 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:02.050765 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-1e8c46f9-1feb-4398-b998-f303a45d8a41 req-bdeec435-e3b4-427f-934f-9892edbbcf4d service nova] Creating event network-vif-deleted:1140d1a5-d0e0-4a81-83a0-d2ef896b5b43 for instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 on hv-cinder-maste Jul 24 01:13:02.059525 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-1e8c46f9-1feb-4398-b998-f303a45d8a41 req-bdeec435-e3b4-427f-934f-9892edbbcf4d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051301 Jul 24 01:13:02.060679 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 99/191] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:02.367700 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-01eb84f9-a010-4655-adf0-ec3ca4084ff8 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:02.368316 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-01eb84f9-a010-4655-adf0-ec3ca4084ff8 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:02.381275 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-01eb84f9-a010-4655-adf0-ec3ca4084ff8 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:02.381760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-01eb84f9-a010-4655-adf0-ec3ca4084ff8 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:02.382539 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-01eb84f9-a010-4655-adf0-ec3ca4084ff8 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:02.382970 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-01eb84f9-a010-4655-adf0-ec3ca4084ff8 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:02.487513 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ca82afd0-d560-4663-8d9e-00c87702d3c3 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:02.489146 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ca82afd0-d560-4663-8d9e-00c87702d3c3 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:02.503721 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ca82afd0-d560-4663-8d9e-00c87702d3c3 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:02.505705 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ca82afd0-d560-4663-8d9e-00c87702d3c3 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:02.510037 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ca82afd0-d560-4663-8d9e-00c87702d3c3 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:02.510918 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ca82afd0-d560-4663-8d9e-00c87702d3c3 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:02.521151 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-01eb84f9-a010-4655-adf0-ec3ca4084ff8 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:02.541153 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-01eb84f9-a010-4655-adf0-ec3ca4084ff8 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1512 microversion: 2.1 time: 0.175134 Jul 24 01:13:02.543174 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 93/192] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:02 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:02.730709 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ca82afd0-d560-4663-8d9e-00c87702d3c3 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:02.740398 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ca82afd0-d560-4663-8d9e-00c87702d3c3 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.262273 Jul 24 01:13:02.741767 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 100/193] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:02 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:03.050462 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-363966c4-6648-4781-a60f-01afdf21d242 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:03.051091 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-363966c4-6648-4781-a60f-01afdf21d242 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:03.066527 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-363966c4-6648-4781-a60f-01afdf21d242 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.066976 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-363966c4-6648-4781-a60f-01afdf21d242 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.067897 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-363966c4-6648-4781-a60f-01afdf21d242 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.068331 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-363966c4-6648-4781-a60f-01afdf21d242 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.312878 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-363966c4-6648-4781-a60f-01afdf21d242 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:03.324358 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-363966c4-6648-4781-a60f-01afdf21d242 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.281949 Jul 24 01:13:03.324832 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 94/194] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:03 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:03.558524 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-93b4a473-6951-43ec-baa0-28bd088f1f84 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:03.559026 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-93b4a473-6951-43ec-baa0-28bd088f1f84 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:03.566525 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-93b4a473-6951-43ec-baa0-28bd088f1f84 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.573135 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-93b4a473-6951-43ec-baa0-28bd088f1f84 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.577588 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-93b4a473-6951-43ec-baa0-28bd088f1f84 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.578046 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-93b4a473-6951-43ec-baa0-28bd088f1f84 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.758700 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-876ecc56-8484-463b-9a5f-2e3585a5fd52 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:03.759368 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-876ecc56-8484-463b-9a5f-2e3585a5fd52 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:03.771232 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-93b4a473-6951-43ec-baa0-28bd088f1f84 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7d2c987db04aaabc0d75c1930f9c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e076ee7a9aba4327977e47cd15f4d598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:03.775388 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-876ecc56-8484-463b-9a5f-2e3585a5fd52 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.775749 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-876ecc56-8484-463b-9a5f-2e3585a5fd52 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.776521 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-876ecc56-8484-463b-9a5f-2e3585a5fd52 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.776950 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-876ecc56-8484-463b-9a5f-2e3585a5fd52 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.787599 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-93b4a473-6951-43ec-baa0-28bd088f1f84 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 200 len: 1346 microversion: 2.1 time: 0.232937 Jul 24 01:13:03.789961 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 101/195] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:03 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 1346 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:04.067067 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-876ecc56-8484-463b-9a5f-2e3585a5fd52 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:04.085959 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-876ecc56-8484-463b-9a5f-2e3585a5fd52 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.331139 Jul 24 01:13:04.087038 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 95/196] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:03 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:04.341546 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0ade990a-07c0-49af-a7a7-3e908d400dea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:04.342301 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0ade990a-07c0-49af-a7a7-3e908d400dea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:04.357004 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0ade990a-07c0-49af-a7a7-3e908d400dea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:04.357471 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0ade990a-07c0-49af-a7a7-3e908d400dea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:04.358260 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0ade990a-07c0-49af-a7a7-3e908d400dea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:04.358710 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0ade990a-07c0-49af-a7a7-3e908d400dea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:04.708174 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-0ade990a-07c0-49af-a7a7-3e908d400dea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:04.719721 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0ade990a-07c0-49af-a7a7-3e908d400dea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.381944 Jul 24 01:13:04.721327 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 102/197] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:04 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:04.822201 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:04.823457 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:04.832790 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:04.833487 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:04.835171 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:04.835964 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:04.869432 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] HTTP exception thrown: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Request method failure captured: Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 HTTP/1.1 Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxafGX488I5mvwrGncCJmTSrH90DdBKwkgLwasba1xVJ9X18W6-3Iz4QYnEnMn6Syzjyfr-K6a9M61EhUPZTX5sJdgff7ciiEPDwszO8WEQHWSWexx6D93DpsqFNP7cDsDsL75Qe2rbD9ecbUfE-JOOfCOHwlKWTdKPoMCyHSR5EtM Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: e076ee7a9aba4327977e47cd15f4d598 Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:13:04.875742 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e076ee7a9aba4327977e47cd15f4d598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e076ee7a9aba4327977e47cd15f4d598", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e076ee7a9aba4327977e47cd15f4d598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e076ee7a9aba4327977e47cd15f4d598"}]}] Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: e076ee7a9aba4327977e47cd15f4d598 Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-DeleteServersTestJSON-771332110-project Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 2d7d2c987db04aaabc0d75c1930f9c6f Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-DeleteServersTestJSON-771332110-project Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:04.877089 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '76253536-dc6f-41fe-b9b9-07f62cd2ea50'} Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:04.877919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:04.879159 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:04.881588 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Returning 404 to user: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:04.883876 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c0a96dc5-cbc8-4719-8dab-47b5107dfa71 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 404 len: 111 microversion: 2.1 time: 0.077723 Jul 24 01:13:04.884615 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 96/198] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:04 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:05.042439 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:05.043458 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:05.054445 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:05.055078 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:05.056449 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:05.057217 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:05.071909 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] HTTP exception thrown: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Request method failure captured: Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50/os-volume_attachments HTTP/1.1 Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxafGX488I5mvwrGncCJmTSrH90DdBKwkgLwasba1xVJ9X18W6-3Iz4QYnEnMn6Syzjyfr-K6a9M61EhUPZTX5sJdgff7ciiEPDwszO8WEQHWSWexx6D93DpsqFNP7cDsDsL75Qe2rbD9ecbUfE-JOOfCOHwlKWTdKPoMCyHSR5EtM Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: e076ee7a9aba4327977e47cd15f4d598 Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:13:05.080941 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e076ee7a9aba4327977e47cd15f4d598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e076ee7a9aba4327977e47cd15f4d598", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e076ee7a9aba4327977e47cd15f4d598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e076ee7a9aba4327977e47cd15f4d598"}]}] Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: e076ee7a9aba4327977e47cd15f4d598 Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-DeleteServersTestJSON-771332110-project Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 2d7d2c987db04aaabc0d75c1930f9c6f Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-DeleteServersTestJSON-771332110-project Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:05.082363 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'server_id': '76253536-dc6f-41fe-b9b9-07f62cd2ea50'} Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:05.083377 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:05.084683 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:05.086056 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Returning 404 to user: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:05.086056 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f1a5af45-1a3a-4bfe-afb4-9c8a4f738620 tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044158 Jul 24 01:13:05.086563 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 103/199] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:13:05 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:05.103595 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-82340e95-3551-4217-a809-74e03a7b40f2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:05.104345 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-82340e95-3551-4217-a809-74e03a7b40f2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:05.113346 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-82340e95-3551-4217-a809-74e03a7b40f2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:05.119142 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-82340e95-3551-4217-a809-74e03a7b40f2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:05.120235 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-82340e95-3551-4217-a809-74e03a7b40f2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:05.122771 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-82340e95-3551-4217-a809-74e03a7b40f2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:05.375696 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-82340e95-3551-4217-a809-74e03a7b40f2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:05.387589 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-82340e95-3551-4217-a809-74e03a7b40f2 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.287683 Jul 24 01:13:05.388355 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 97/200] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:05 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:05.737164 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d8ff688a-62ce-4498-b86e-e201aee53f57 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:05.738440 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d8ff688a-62ce-4498-b86e-e201aee53f57 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:05.749682 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d8ff688a-62ce-4498-b86e-e201aee53f57 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:05.751780 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d8ff688a-62ce-4498-b86e-e201aee53f57 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:05.753565 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d8ff688a-62ce-4498-b86e-e201aee53f57 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:05.754158 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d8ff688a-62ce-4498-b86e-e201aee53f57 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.046944 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d8ff688a-62ce-4498-b86e-e201aee53f57 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:06.059777 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d8ff688a-62ce-4498-b86e-e201aee53f57 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.326721 Jul 24 01:13:06.060466 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 104/201] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:05 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:06.346143 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:06.347892 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:06.357678 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.358437 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.359872 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.360458 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.380908 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] HTTP exception thrown: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Request method failure captured: Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: DELETE /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 HTTP/1.1 Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxafGX488I5mvwrGncCJmTSrH90DdBKwkgLwasba1xVJ9X18W6-3Iz4QYnEnMn6Syzjyfr-K6a9M61EhUPZTX5sJdgff7ciiEPDwszO8WEQHWSWexx6D93DpsqFNP7cDsDsL75Qe2rbD9ecbUfE-JOOfCOHwlKWTdKPoMCyHSR5EtM Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: e076ee7a9aba4327977e47cd15f4d598 Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:13:06.384392 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e076ee7a9aba4327977e47cd15f4d598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e076ee7a9aba4327977e47cd15f4d598", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e076ee7a9aba4327977e47cd15f4d598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e076ee7a9aba4327977e47cd15f4d598"}]}] Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: e076ee7a9aba4327977e47cd15f4d598 Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-DeleteServersTestJSON-771332110-project Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 2d7d2c987db04aaabc0d75c1930f9c6f Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-DeleteServersTestJSON-771332110-project Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.386050 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '76253536-dc6f-41fe-b9b9-07f62cd2ea50'} Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:06.386884 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.388274 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.391450 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Returning 404 to user: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:06.392759 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-894e723b-93a1-40de-b79c-9e99ab9ef5ca tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "DELETE /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 404 len: 111 microversion: 2.1 time: 0.052000 Jul 24 01:13:06.394296 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 98/202] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:13:06 2022] DELETE /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:06.405254 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:06.405986 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] [instance: 76253536-dc6f-41fe-b9b9-07f62cd2ea50] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:06.414075 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.414908 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.416689 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.417386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.419926 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-794fd90d-6bf4-4d0c-b8ca-9557016e53b1 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:06.421026 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-794fd90d-6bf4-4d0c-b8ca-9557016e53b1 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:06.433218 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-794fd90d-6bf4-4d0c-b8ca-9557016e53b1 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.435577 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-794fd90d-6bf4-4d0c-b8ca-9557016e53b1 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.436712 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-794fd90d-6bf4-4d0c-b8ca-9557016e53b1 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.437376 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-794fd90d-6bf4-4d0c-b8ca-9557016e53b1 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.437627 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] HTTP exception thrown: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Request method failure captured: Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 HTTP/1.1 Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxafGX488I5mvwrGncCJmTSrH90DdBKwkgLwasba1xVJ9X18W6-3Iz4QYnEnMn6Syzjyfr-K6a9M61EhUPZTX5sJdgff7ciiEPDwszO8WEQHWSWexx6D93DpsqFNP7cDsDsL75Qe2rbD9ecbUfE-JOOfCOHwlKWTdKPoMCyHSR5EtM Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: e076ee7a9aba4327977e47cd15f4d598 Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:13:06.443544 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e076ee7a9aba4327977e47cd15f4d598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e076ee7a9aba4327977e47cd15f4d598", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e076ee7a9aba4327977e47cd15f4d598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e076ee7a9aba4327977e47cd15f4d598"}]}] Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: e076ee7a9aba4327977e47cd15f4d598 Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-DeleteServersTestJSON-771332110 Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-DeleteServersTestJSON-771332110-project Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 2d7d2c987db04aaabc0d75c1930f9c6f Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-DeleteServersTestJSON-771332110-project Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.445055 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '76253536-dc6f-41fe-b9b9-07f62cd2ea50'} Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:06.445748 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. Jul 24 01:13:06.446799 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:06.448315 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] Returning 404 to user: Instance 76253536-dc6f-41fe-b9b9-07f62cd2ea50 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:06.450039 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f8bf9d88-4963-4a67-964f-6901b117fbaf tempest-DeleteServersTestJSON-771332110 tempest-DeleteServersTestJSON-771332110-project] 10.222.0.42 "GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50" status: 404 len: 111 microversion: 2.1 time: 0.050545 Jul 24 01:13:06.450626 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 105/203] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:06 2022] GET /compute/v2.1/servers/76253536-dc6f-41fe-b9b9-07f62cd2ea50 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:06.763276 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-794fd90d-6bf4-4d0c-b8ca-9557016e53b1 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:06.774434 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-794fd90d-6bf4-4d0c-b8ca-9557016e53b1 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.363358 Jul 24 01:13:06.775095 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 99/204] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:06 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:07.077420 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ed3aa4f5-9123-4cac-84a6-87c8ed209e82 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:07.078027 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ed3aa4f5-9123-4cac-84a6-87c8ed209e82 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:07.084949 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ed3aa4f5-9123-4cac-84a6-87c8ed209e82 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:07.085636 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ed3aa4f5-9123-4cac-84a6-87c8ed209e82 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:07.086638 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ed3aa4f5-9123-4cac-84a6-87c8ed209e82 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:07.087241 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ed3aa4f5-9123-4cac-84a6-87c8ed209e82 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:07.245285 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-5f4b4f85-fd65-4cf4-9187-e1837c665e05 req-8e92408d-c405-4175-b809-2ef1da24133f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa9afe68-ce8f-45f0-8f35-aa5e752a77d2", "name": "network-vif-plugged", "status": "completed", "tag": "9ed9cc10-e24b-46c5-b4b7-2c23c5e2258c"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:07.263499 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-5f4b4f85-fd65-4cf4-9187-e1837c665e05 req-8e92408d-c405-4175-b809-2ef1da24133f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:07.263935 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-5f4b4f85-fd65-4cf4-9187-e1837c665e05 req-8e92408d-c405-4175-b809-2ef1da24133f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:07.272615 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ed3aa4f5-9123-4cac-84a6-87c8ed209e82 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:07.280235 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-5f4b4f85-fd65-4cf4-9187-e1837c665e05 req-8e92408d-c405-4175-b809-2ef1da24133f service nova] Creating event network-vif-plugged:9ed9cc10-e24b-46c5-b4b7-2c23c5e2258c for instance aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 on hv-cinder-maste Jul 24 01:13:07.282162 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ed3aa4f5-9123-4cac-84a6-87c8ed209e82 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.209085 Jul 24 01:13:07.284193 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 106/205] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:07 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:07.297230 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-5f4b4f85-fd65-4cf4-9187-e1837c665e05 req-8e92408d-c405-4175-b809-2ef1da24133f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055609 Jul 24 01:13:07.298180 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 100/206] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:13:07.792537 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-06a958c1-730b-4543-b05d-86c51841fedc tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:07.793333 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-06a958c1-730b-4543-b05d-86c51841fedc tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:07.821546 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-06a958c1-730b-4543-b05d-86c51841fedc tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:07.848860 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-06a958c1-730b-4543-b05d-86c51841fedc tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:07.852131 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-06a958c1-730b-4543-b05d-86c51841fedc tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:07.852750 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-06a958c1-730b-4543-b05d-86c51841fedc tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.081134 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-06a958c1-730b-4543-b05d-86c51841fedc tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:08.093115 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-06a958c1-730b-4543-b05d-86c51841fedc tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.305403 Jul 24 01:13:08.094238 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 107/207] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:07 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:08.306893 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-dee120f3-6a43-42e9-9c7e-adb6f6fd2f32 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:08.308243 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-dee120f3-6a43-42e9-9c7e-adb6f6fd2f32 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:08.331694 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dee120f3-6a43-42e9-9c7e-adb6f6fd2f32 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:08.337800 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dee120f3-6a43-42e9-9c7e-adb6f6fd2f32 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.339531 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dee120f3-6a43-42e9-9c7e-adb6f6fd2f32 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:08.340147 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dee120f3-6a43-42e9-9c7e-adb6f6fd2f32 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.573185 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-dee120f3-6a43-42e9-9c7e-adb6f6fd2f32 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:08.584077 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-dee120f3-6a43-42e9-9c7e-adb6f6fd2f32 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.288556 Jul 24 01:13:08.585647 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 101/208] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:08 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:09.110248 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-eb2a48ec-92be-4bda-9c5f-419a60483633 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:09.111503 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-eb2a48ec-92be-4bda-9c5f-419a60483633 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:09.123779 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb2a48ec-92be-4bda-9c5f-419a60483633 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:09.124507 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb2a48ec-92be-4bda-9c5f-419a60483633 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:09.125424 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb2a48ec-92be-4bda-9c5f-419a60483633 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:09.125996 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb2a48ec-92be-4bda-9c5f-419a60483633 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:09.431398 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-eb2a48ec-92be-4bda-9c5f-419a60483633 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:09.441917 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-eb2a48ec-92be-4bda-9c5f-419a60483633 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1314 microversion: 2.1 time: 0.335621 Jul 24 01:13:09.444533 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 108/209] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:09 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:09.603063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-db714b4e-34c3-4c68-89ff-3016ed909f72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:09.604320 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-db714b4e-34c3-4c68-89ff-3016ed909f72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:09.621474 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-db714b4e-34c3-4c68-89ff-3016ed909f72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:09.621920 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-db714b4e-34c3-4c68-89ff-3016ed909f72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:09.632577 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-db714b4e-34c3-4c68-89ff-3016ed909f72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:09.633038 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-db714b4e-34c3-4c68-89ff-3016ed909f72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.140462 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-db714b4e-34c3-4c68-89ff-3016ed909f72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:10.159132 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-db714b4e-34c3-4c68-89ff-3016ed909f72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.561235 Jul 24 01:13:10.187094 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 102/210] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:09 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:10.459249 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e0c8c0c7-9476-4136-b571-eb54936c2698 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:10.459966 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e0c8c0c7-9476-4136-b571-eb54936c2698 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:10.469216 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e0c8c0c7-9476-4136-b571-eb54936c2698 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.473171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e0c8c0c7-9476-4136-b571-eb54936c2698 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.474004 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e0c8c0c7-9476-4136-b571-eb54936c2698 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.474443 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e0c8c0c7-9476-4136-b571-eb54936c2698 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.489780 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=100 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:10.736963 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e0c8c0c7-9476-4136-b571-eb54936c2698 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:10.747677 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e0c8c0c7-9476-4136-b571-eb54936c2698 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1498 microversion: 2.1 time: 0.292182 Jul 24 01:13:10.748916 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 109/211] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:10 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1498 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:11.191083 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-57a2cc9e-763f-4e33-8561-138845a56e6c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:11.191772 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-57a2cc9e-763f-4e33-8561-138845a56e6c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:11.210646 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57a2cc9e-763f-4e33-8561-138845a56e6c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:11.212999 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57a2cc9e-763f-4e33-8561-138845a56e6c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:11.215788 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57a2cc9e-763f-4e33-8561-138845a56e6c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:11.216445 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57a2cc9e-763f-4e33-8561-138845a56e6c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:11.573500 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-57a2cc9e-763f-4e33-8561-138845a56e6c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:11.582397 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-57a2cc9e-763f-4e33-8561-138845a56e6c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.395338 Jul 24 01:13:11.583587 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 103/212] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:11 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:12.600038 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4c97d9c0-aa69-435a-b051-e7eef1952354 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:12.600744 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4c97d9c0-aa69-435a-b051-e7eef1952354 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:12.608693 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c97d9c0-aa69-435a-b051-e7eef1952354 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:12.609536 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c97d9c0-aa69-435a-b051-e7eef1952354 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:12.614059 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c97d9c0-aa69-435a-b051-e7eef1952354 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:12.614665 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4c97d9c0-aa69-435a-b051-e7eef1952354 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:12.851191 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4c97d9c0-aa69-435a-b051-e7eef1952354 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:12.862149 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4c97d9c0-aa69-435a-b051-e7eef1952354 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.265841 Jul 24 01:13:12.862965 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 110/213] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:12 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:13.878786 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-caca8e33-faaf-49e4-8e15-ce0f5ec4cd31 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:13.887817 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-caca8e33-faaf-49e4-8e15-ce0f5ec4cd31 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:13.910799 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-caca8e33-faaf-49e4-8e15-ce0f5ec4cd31 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:13.911356 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-caca8e33-faaf-49e4-8e15-ce0f5ec4cd31 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:13.913471 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-caca8e33-faaf-49e4-8e15-ce0f5ec4cd31 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:13.913941 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-caca8e33-faaf-49e4-8e15-ce0f5ec4cd31 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.163729 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-caca8e33-faaf-49e4-8e15-ce0f5ec4cd31 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:14.174882 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-caca8e33-faaf-49e4-8e15-ce0f5ec4cd31 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.299590 Jul 24 01:13:14.183389 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 104/214] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:13 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:14.481318 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e7880a15-b6f8-4c22-9bef-dc4d550e502c tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:14.482589 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e7880a15-b6f8-4c22-9bef-dc4d550e502c tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:14.489192 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7880a15-b6f8-4c22-9bef-dc4d550e502c tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:14.489884 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7880a15-b6f8-4c22-9bef-dc4d550e502c tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.490646 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7880a15-b6f8-4c22-9bef-dc4d550e502c tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:14.491131 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7880a15-b6f8-4c22-9bef-dc4d550e502c tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.518968 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e7880a15-b6f8-4c22-9bef-dc4d550e502c tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Going to try to terminate instance {{(pid=118036) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:13:14.641034 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e7880a15-b6f8-4c22-9bef-dc4d550e502c tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 204 len: 0 microversion: 2.1 time: 0.162936 Jul 24 01:13:14.642426 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 111/215] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:13:14 2022] DELETE /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:13:14.651381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-08d4dbd3-a328-4421-8cad-f8d620304553 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:14.652078 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-08d4dbd3-a328-4421-8cad-f8d620304553 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:14.663795 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-08d4dbd3-a328-4421-8cad-f8d620304553 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:14.666448 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-08d4dbd3-a328-4421-8cad-f8d620304553 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.667203 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-08d4dbd3-a328-4421-8cad-f8d620304553 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:14.667676 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-08d4dbd3-a328-4421-8cad-f8d620304553 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.678639 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:14.854410 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-08d4dbd3-a328-4421-8cad-f8d620304553 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:14.870714 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-08d4dbd3-a328-4421-8cad-f8d620304553 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1504 microversion: 2.1 time: 0.223571 Jul 24 01:13:14.871615 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 105/216] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:14 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:15.194608 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-702c7651-aa5a-46ee-8b51-c3bfb82ca408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:15.195421 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-702c7651-aa5a-46ee-8b51-c3bfb82ca408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:15.201907 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:15.203949 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-702c7651-aa5a-46ee-8b51-c3bfb82ca408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.204469 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-702c7651-aa5a-46ee-8b51-c3bfb82ca408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:15.205562 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-702c7651-aa5a-46ee-8b51-c3bfb82ca408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.206307 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-702c7651-aa5a-46ee-8b51-c3bfb82ca408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:15.367350 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-702c7651-aa5a-46ee-8b51-c3bfb82ca408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:15.382525 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-702c7651-aa5a-46ee-8b51-c3bfb82ca408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.192668 Jul 24 01:13:15.391377 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 112/217] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:15 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:15.888180 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1e98271e-4654-4257-a699-c73d150860be tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:15.889022 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1e98271e-4654-4257-a699-c73d150860be tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:15.896028 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e98271e-4654-4257-a699-c73d150860be tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.896705 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e98271e-4654-4257-a699-c73d150860be tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:15.897931 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e98271e-4654-4257-a699-c73d150860be tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.898505 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e98271e-4654-4257-a699-c73d150860be tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.096107 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1e98271e-4654-4257-a699-c73d150860be tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:16.104475 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1e98271e-4654-4257-a699-c73d150860be tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1504 microversion: 2.1 time: 0.220197 Jul 24 01:13:16.116273 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 106/218] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:15 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:16.402200 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-28def971-aab5-461a-85af-e11dc1f354e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:16.402813 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-28def971-aab5-461a-85af-e11dc1f354e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:16.410188 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-28def971-aab5-461a-85af-e11dc1f354e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:16.410634 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-28def971-aab5-461a-85af-e11dc1f354e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.411456 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-28def971-aab5-461a-85af-e11dc1f354e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:16.411981 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-28def971-aab5-461a-85af-e11dc1f354e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.631068 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-28def971-aab5-461a-85af-e11dc1f354e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:16.641615 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-28def971-aab5-461a-85af-e11dc1f354e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.243518 Jul 24 01:13:16.642622 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 113/219] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:16 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:17.131035 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e80e2196-830c-4886-8639-eaa26990ad18 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.132046 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e80e2196-830c-4886-8639-eaa26990ad18 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:17.144287 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e80e2196-830c-4886-8639-eaa26990ad18 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.144739 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e80e2196-830c-4886-8639-eaa26990ad18 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.147162 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e80e2196-830c-4886-8639-eaa26990ad18 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.147792 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e80e2196-830c-4886-8639-eaa26990ad18 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.442615 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e80e2196-830c-4886-8639-eaa26990ad18 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e9ac94e391429887296c4da62f30b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d043fc94e647b5864b2d44ae419fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:17.453981 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e80e2196-830c-4886-8639-eaa26990ad18 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 200 len: 1504 microversion: 2.1 time: 0.323331 Jul 24 01:13:17.454623 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 107/220] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:17 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:17.468640 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-5360ab4d-758b-4803-af03-7113f919e534 req-db9bbb3d-3691-4e0c-929b-1444aa39cc78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa9afe68-ce8f-45f0-8f35-aa5e752a77d2", "name": "network-vif-deleted", "tag": "9ed9cc10-e24b-46c5-b4b7-2c23c5e2258c"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:17.480668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-5360ab4d-758b-4803-af03-7113f919e534 req-db9bbb3d-3691-4e0c-929b-1444aa39cc78 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.481476 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-5360ab4d-758b-4803-af03-7113f919e534 req-db9bbb3d-3691-4e0c-929b-1444aa39cc78 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.494446 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-5360ab4d-758b-4803-af03-7113f919e534 req-db9bbb3d-3691-4e0c-929b-1444aa39cc78 service nova] Creating event network-vif-deleted:9ed9cc10-e24b-46c5-b4b7-2c23c5e2258c for instance aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 on hv-cinder-maste Jul 24 01:13:17.507344 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-5360ab4d-758b-4803-af03-7113f919e534 req-db9bbb3d-3691-4e0c-929b-1444aa39cc78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042264 Jul 24 01:13:17.508819 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 114/221] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:17.665050 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7b316817-e1d4-4965-986a-c1b3a0063383 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.665797 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7b316817-e1d4-4965-986a-c1b3a0063383 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:17.678987 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7b316817-e1d4-4965-986a-c1b3a0063383 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.680287 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7b316817-e1d4-4965-986a-c1b3a0063383 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.681577 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7b316817-e1d4-4965-986a-c1b3a0063383 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.682168 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7b316817-e1d4-4965-986a-c1b3a0063383 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.866395 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7b316817-e1d4-4965-986a-c1b3a0063383 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:17.880426 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7b316817-e1d4-4965-986a-c1b3a0063383 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.223406 Jul 24 01:13:17.889854 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 108/222] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:17 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:18.475695 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:18.476387 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] [instance: aa9afe68-ce8f-45f0-8f35-aa5e752a77d2] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:18.485223 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:18.485672 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:18.486436 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:18.486859 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:18.519907 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] HTTP exception thrown: Instance aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 could not be found. Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Request method failure captured: Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 HTTP/1.1 Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JyL-oqKOdFsRV2YExufFHNn7SE1xbjLHQhLEbjxoKMPvLOjQYmk7PcKyK3L4rg-do2o3HbHzxtkcFGFu6I72JtAIzdIUbr6TJFfJWbkD72h3v341NikGDHlBGB4zTGykqEK9CsvaglkrdDlMSRj8WyH-Stys5zAE_y1R3DaxXTxwSw Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: b8d043fc94e647b5864b2d44ae419fa5 Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesActionsTest-801054367 Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:13:18.521536 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8d043fc94e647b5864b2d44ae419fa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8d043fc94e647b5864b2d44ae419fa5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8d043fc94e647b5864b2d44ae419fa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8d043fc94e647b5864b2d44ae419fa5"}]}] Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesActionsTest-801054367 Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: b8d043fc94e647b5864b2d44ae419fa5 Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesActionsTest-801054367 Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesActionsTest-801054367-project Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: b9e9ac94e391429887296c4da62f30b5 Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesActionsTest-801054367-project Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 could not be found. Jul 24 01:13:18.523078 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'aa9afe68-ce8f-45f0-8f35-aa5e752a77d2'} Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 could not be found. Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:18.523879 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 could not be found. Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 could not be found. Jul 24 01:13:18.525283 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:13:18.526645 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] Returning 404 to user: Instance aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:18.526645 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c7b92840-fb96-4325-86f0-258c36ca7f62 tempest-VolumesActionsTest-801054367 tempest-VolumesActionsTest-801054367-project] 10.222.0.42 "GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2" status: 404 len: 111 microversion: 2.1 time: 0.051730 Jul 24 01:13:18.526645 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 115/223] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:18 2022] GET /compute/v2.1/servers/aa9afe68-ce8f-45f0-8f35-aa5e752a77d2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:18.898729 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-bad13735-5f04-47fd-b70d-0db82ff1d59e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:18.902202 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-bad13735-5f04-47fd-b70d-0db82ff1d59e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:18.919273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bad13735-5f04-47fd-b70d-0db82ff1d59e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:18.920098 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bad13735-5f04-47fd-b70d-0db82ff1d59e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:18.922681 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bad13735-5f04-47fd-b70d-0db82ff1d59e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:18.924265 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bad13735-5f04-47fd-b70d-0db82ff1d59e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:19.105476 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-bad13735-5f04-47fd-b70d-0db82ff1d59e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:19.120525 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-bad13735-5f04-47fd-b70d-0db82ff1d59e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.227350 Jul 24 01:13:19.121914 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 109/224] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:18 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:20.137578 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ee48227f-a761-418b-b42e-df3a62d0ea2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:20.138173 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ee48227f-a761-418b-b42e-df3a62d0ea2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:20.146485 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee48227f-a761-418b-b42e-df3a62d0ea2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.147235 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee48227f-a761-418b-b42e-df3a62d0ea2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:20.148237 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee48227f-a761-418b-b42e-df3a62d0ea2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.148824 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee48227f-a761-418b-b42e-df3a62d0ea2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:20.502925 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ee48227f-a761-418b-b42e-df3a62d0ea2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:20.512531 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ee48227f-a761-418b-b42e-df3a62d0ea2a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.378361 Jul 24 01:13:20.513427 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 116/225] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:20 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:21.057340 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4adc063b-2db2-4d95-9575-04ea5f574107 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Action: 'create', calling method: .version_select at 0x7fdf3e9f50d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1487358931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH3kxlyTEyLoEswG2jo6FHvMffYUkqNJ4l18qdebxq6iv9CL34U/q3c1KZk4pdqSnwdXuUEn9/N2DN8U9/bYsU06XuAFEcVRomhRa11mAdj7jwkVbLg3lnQcU+0T5C6XQ=="}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:21.078233 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-4adc063b-2db2-4d95-9575-04ea5f574107 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Getting quotas for project 083e6e1f36c3453da2befa06a4875014. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:21.085530 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-4adc063b-2db2-4d95-9575-04ea5f574107 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Getting quotas for user 9a0398a0ec144dfcbcc4c92fc54d4dee and project 083e6e1f36c3453da2befa06a4875014. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:21.141871 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4adc063b-2db2-4d95-9575-04ea5f574107 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.089417 Jul 24 01:13:21.151907 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 110/226] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Jul 24 01:13:21 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:21.253346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-384464583", "imageRef": "62ba43b2-9e78-468c-9e95-893fb6f90f93", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1487358931", "networks": [{"uuid": "b4eb63d8-a9c4-4e5c-9902-9096c34e0dc8"}]}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:21.315635 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] validate_networks() for [('b4eb63d8-a9c4-4e5c-9902-9096c34e0dc8', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:13:21.529955 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-87309a24-954f-4c9f-a6ac-17983c294fea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:21.530577 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-87309a24-954f-4c9f-a6ac-17983c294fea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:21.536962 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-87309a24-954f-4c9f-a6ac-17983c294fea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:21.537415 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-87309a24-954f-4c9f-a6ac-17983c294fea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:21.544251 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-87309a24-954f-4c9f-a6ac-17983c294fea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:21.544714 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-87309a24-954f-4c9f-a6ac-17983c294fea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:21.776657 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-87309a24-954f-4c9f-a6ac-17983c294fea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:21.789131 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-87309a24-954f-4c9f-a6ac-17983c294fea tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.263224 Jul 24 01:13:21.792406 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 111/227] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:21 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:21.890054 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:13:21.890482 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:13:21.890956 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:13:21.891416 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:13:21.892473 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:13:21.909656 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:21.910619 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:21.912260 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:21.913327 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:21.936298 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Getting quotas for project 083e6e1f36c3453da2befa06a4875014. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:21.943682 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Getting quotas for user 9a0398a0ec144dfcbcc4c92fc54d4dee and project 083e6e1f36c3453da2befa06a4875014. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:21.957524 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:13:21.959022 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='62ba43b2-9e78-468c-9e95-893fb6f90f93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:13:22.010483 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f03587d8-f7be-4f5a-afd5-2f205d83d993 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762086 Jul 24 01:13:22.011613 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 117/228] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:13:22.021265 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3000284f-9234-4af3-bafd-1c508a9221c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:22.022445 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3000284f-9234-4af3-bafd-1c508a9221c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:22.080836 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3000284f-9234-4af3-bafd-1c508a9221c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:22.087653 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3000284f-9234-4af3-bafd-1c508a9221c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1258 microversion: 2.1 time: 0.070279 Jul 24 01:13:22.088222 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 112/229] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:22 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:22.808462 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-60fa1ca8-bc7d-4d6f-a260-64ee33872c8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:22.809145 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-60fa1ca8-bc7d-4d6f-a260-64ee33872c8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:22.815554 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-60fa1ca8-bc7d-4d6f-a260-64ee33872c8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:22.816018 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-60fa1ca8-bc7d-4d6f-a260-64ee33872c8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:22.816747 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-60fa1ca8-bc7d-4d6f-a260-64ee33872c8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:22.817176 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-60fa1ca8-bc7d-4d6f-a260-64ee33872c8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:22.959566 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-60fa1ca8-bc7d-4d6f-a260-64ee33872c8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:22.968345 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-60fa1ca8-bc7d-4d6f-a260-64ee33872c8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.163863 Jul 24 01:13:22.978337 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 118/230] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:22 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:23.104525 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8aa9ba19-c941-49c0-abef-daf049b69f9c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:23.105160 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8aa9ba19-c941-49c0-abef-daf049b69f9c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:23.112583 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8aa9ba19-c941-49c0-abef-daf049b69f9c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:23.113937 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8aa9ba19-c941-49c0-abef-daf049b69f9c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:23.114720 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8aa9ba19-c941-49c0-abef-daf049b69f9c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:23.115155 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8aa9ba19-c941-49c0-abef-daf049b69f9c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:23.208303 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8aa9ba19-c941-49c0-abef-daf049b69f9c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:23.216205 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8aa9ba19-c941-49c0-abef-daf049b69f9c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1318 microversion: 2.1 time: 0.115964 Jul 24 01:13:23.216842 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 113/231] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:23 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1318 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:23.985717 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c825174a-a51e-4289-be45-cf1b48db7ca8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:23.986707 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c825174a-a51e-4289-be45-cf1b48db7ca8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:23.998654 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c825174a-a51e-4289-be45-cf1b48db7ca8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:24.000193 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c825174a-a51e-4289-be45-cf1b48db7ca8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:24.003479 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c825174a-a51e-4289-be45-cf1b48db7ca8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:24.003979 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c825174a-a51e-4289-be45-cf1b48db7ca8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:24.232909 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-955f04f3-81ff-4ebb-82ad-63cfd346dd0f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:24.234106 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-955f04f3-81ff-4ebb-82ad-63cfd346dd0f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:24.245178 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-955f04f3-81ff-4ebb-82ad-63cfd346dd0f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:24.245780 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-955f04f3-81ff-4ebb-82ad-63cfd346dd0f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:24.246976 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-955f04f3-81ff-4ebb-82ad-63cfd346dd0f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:24.247563 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-955f04f3-81ff-4ebb-82ad-63cfd346dd0f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:24.536843 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c825174a-a51e-4289-be45-cf1b48db7ca8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:24.550723 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c825174a-a51e-4289-be45-cf1b48db7ca8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.567965 Jul 24 01:13:24.552954 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 119/232] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:23 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:24.627466 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-955f04f3-81ff-4ebb-82ad-63cfd346dd0f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:24.655541 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-955f04f3-81ff-4ebb-82ad-63cfd346dd0f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.426246 Jul 24 01:13:24.656154 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 114/233] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:24 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:25.572970 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-02ae21e1-042a-4520-99d1-a58dd5870408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:25.573589 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-02ae21e1-042a-4520-99d1-a58dd5870408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:25.588057 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-02ae21e1-042a-4520-99d1-a58dd5870408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:25.588744 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-02ae21e1-042a-4520-99d1-a58dd5870408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:25.589672 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-02ae21e1-042a-4520-99d1-a58dd5870408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:25.590421 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-02ae21e1-042a-4520-99d1-a58dd5870408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:25.678556 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a582b11d-6343-407c-b442-34227aea63d6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:25.680425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a582b11d-6343-407c-b442-34227aea63d6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:25.695215 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a582b11d-6343-407c-b442-34227aea63d6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:25.696214 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a582b11d-6343-407c-b442-34227aea63d6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:25.696401 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a582b11d-6343-407c-b442-34227aea63d6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:25.700620 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a582b11d-6343-407c-b442-34227aea63d6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:25.766203 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-02ae21e1-042a-4520-99d1-a58dd5870408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:25.803494 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-02ae21e1-042a-4520-99d1-a58dd5870408 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.227372 Jul 24 01:13:25.804371 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 120/234] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:25 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:25.926338 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a582b11d-6343-407c-b442-34227aea63d6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:25.934393 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a582b11d-6343-407c-b442-34227aea63d6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.264322 Jul 24 01:13:25.934974 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 115/235] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:25 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:26.846012 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-dd097268-6d80-4d56-b55c-f6749088e350 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:26.847908 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-dd097268-6d80-4d56-b55c-f6749088e350 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:26.865595 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dd097268-6d80-4d56-b55c-f6749088e350 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:26.866112 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dd097268-6d80-4d56-b55c-f6749088e350 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:26.874855 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dd097268-6d80-4d56-b55c-f6749088e350 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:26.875080 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dd097268-6d80-4d56-b55c-f6749088e350 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:26.951585 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8f6817b5-d724-49ae-b02d-6eb13c0b3a73 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:26.952164 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8f6817b5-d724-49ae-b02d-6eb13c0b3a73 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:26.965528 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:26.967108 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8f6817b5-d724-49ae-b02d-6eb13c0b3a73 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:26.967606 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8f6817b5-d724-49ae-b02d-6eb13c0b3a73 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:26.968398 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8f6817b5-d724-49ae-b02d-6eb13c0b3a73 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:26.968954 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8f6817b5-d724-49ae-b02d-6eb13c0b3a73 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:27.072701 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-dd097268-6d80-4d56-b55c-f6749088e350 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:27.081913 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-dd097268-6d80-4d56-b55c-f6749088e350 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.254267 Jul 24 01:13:27.093555 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 121/236] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:26 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:27.152557 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8f6817b5-d724-49ae-b02d-6eb13c0b3a73 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:27.164712 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8f6817b5-d724-49ae-b02d-6eb13c0b3a73 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.216817 Jul 24 01:13:27.165509 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 116/237] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:26 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:28.100569 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8a2b66b6-1056-4cf9-8a8f-27e878b1b9b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:28.101903 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8a2b66b6-1056-4cf9-8a8f-27e878b1b9b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:28.111345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8a2b66b6-1056-4cf9-8a8f-27e878b1b9b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.111345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8a2b66b6-1056-4cf9-8a8f-27e878b1b9b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.111345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8a2b66b6-1056-4cf9-8a8f-27e878b1b9b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.111345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8a2b66b6-1056-4cf9-8a8f-27e878b1b9b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.187406 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-aba6d0dc-9043-4bf7-adc3-6198a31d63bf tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:28.189035 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-aba6d0dc-9043-4bf7-adc3-6198a31d63bf tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:28.200053 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aba6d0dc-9043-4bf7-adc3-6198a31d63bf tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.201207 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aba6d0dc-9043-4bf7-adc3-6198a31d63bf tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.202664 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aba6d0dc-9043-4bf7-adc3-6198a31d63bf tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.203836 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aba6d0dc-9043-4bf7-adc3-6198a31d63bf tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.333318 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8a2b66b6-1056-4cf9-8a8f-27e878b1b9b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:28.341769 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8a2b66b6-1056-4cf9-8a8f-27e878b1b9b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.245446 Jul 24 01:13:28.351229 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 122/238] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:28 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:28.430142 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-aba6d0dc-9043-4bf7-adc3-6198a31d63bf tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:28.438352 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-aba6d0dc-9043-4bf7-adc3-6198a31d63bf tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.259441 Jul 24 01:13:28.439251 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 117/239] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:28 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:29.358114 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c2da01b7-1ade-4e93-9ed0-ef351139249d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:29.359393 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c2da01b7-1ade-4e93-9ed0-ef351139249d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:29.366428 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c2da01b7-1ade-4e93-9ed0-ef351139249d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:29.367109 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c2da01b7-1ade-4e93-9ed0-ef351139249d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:29.367948 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c2da01b7-1ade-4e93-9ed0-ef351139249d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:29.368816 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c2da01b7-1ade-4e93-9ed0-ef351139249d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:29.457218 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-11ee1489-1506-4085-8e0f-54dec273f20e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:29.458599 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-11ee1489-1506-4085-8e0f-54dec273f20e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:29.466463 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-11ee1489-1506-4085-8e0f-54dec273f20e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:29.467566 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-11ee1489-1506-4085-8e0f-54dec273f20e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:29.468547 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-11ee1489-1506-4085-8e0f-54dec273f20e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:29.469172 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-11ee1489-1506-4085-8e0f-54dec273f20e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:29.559734 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c2da01b7-1ade-4e93-9ed0-ef351139249d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:29.586222 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c2da01b7-1ade-4e93-9ed0-ef351139249d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.232031 Jul 24 01:13:29.602137 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 123/240] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:29 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:29.689345 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-11ee1489-1506-4085-8e0f-54dec273f20e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:29.708628 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-11ee1489-1506-4085-8e0f-54dec273f20e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.255695 Jul 24 01:13:29.709593 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 118/241] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:29 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:30.604300 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7c048982-ab17-4d8c-9a0d-89942de1c3f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:30.605005 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7c048982-ab17-4d8c-9a0d-89942de1c3f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:30.611789 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7c048982-ab17-4d8c-9a0d-89942de1c3f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:30.612238 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7c048982-ab17-4d8c-9a0d-89942de1c3f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:30.613006 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7c048982-ab17-4d8c-9a0d-89942de1c3f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:30.613572 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7c048982-ab17-4d8c-9a0d-89942de1c3f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:30.724666 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2cb477a8-b428-46ff-8b54-3b51b868a111 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:30.725555 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-2cb477a8-b428-46ff-8b54-3b51b868a111 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:30.734064 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2cb477a8-b428-46ff-8b54-3b51b868a111 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:30.734514 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2cb477a8-b428-46ff-8b54-3b51b868a111 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:30.735280 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2cb477a8-b428-46ff-8b54-3b51b868a111 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:30.735877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2cb477a8-b428-46ff-8b54-3b51b868a111 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:30.762037 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7c048982-ab17-4d8c-9a0d-89942de1c3f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:30.776056 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7c048982-ab17-4d8c-9a0d-89942de1c3f7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.175515 Jul 24 01:13:30.777239 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 124/242] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:30 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:30.912867 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2cb477a8-b428-46ff-8b54-3b51b868a111 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:30.920747 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2cb477a8-b428-46ff-8b54-3b51b868a111 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.199807 Jul 24 01:13:30.922258 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 119/243] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:30 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:31.797153 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1a582750-8c25-4f69-843e-9f69bb0edbdd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:31.797900 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1a582750-8c25-4f69-843e-9f69bb0edbdd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:31.806481 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1a582750-8c25-4f69-843e-9f69bb0edbdd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:31.807231 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1a582750-8c25-4f69-843e-9f69bb0edbdd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:31.808264 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1a582750-8c25-4f69-843e-9f69bb0edbdd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:31.808899 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1a582750-8c25-4f69-843e-9f69bb0edbdd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:31.925197 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:31.942025 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4b62a629-f39f-418d-8c0a-2e7b200f20c6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:31.943543 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4b62a629-f39f-418d-8c0a-2e7b200f20c6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:31.951716 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=6 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:31.958601 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4b62a629-f39f-418d-8c0a-2e7b200f20c6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:31.959539 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4b62a629-f39f-418d-8c0a-2e7b200f20c6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:31.960978 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4b62a629-f39f-418d-8c0a-2e7b200f20c6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:31.961603 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4b62a629-f39f-418d-8c0a-2e7b200f20c6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:31.975259 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1a582750-8c25-4f69-843e-9f69bb0edbdd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:31.998642 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1a582750-8c25-4f69-843e-9f69bb0edbdd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.205889 Jul 24 01:13:31.999485 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 125/244] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:31 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:32.085264 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=6 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:32.159086 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4b62a629-f39f-418d-8c0a-2e7b200f20c6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:32.171888 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4b62a629-f39f-418d-8c0a-2e7b200f20c6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.233528 Jul 24 01:13:32.175691 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 120/245] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:31 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:33.017427 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ae9c051b-68c1-495b-a77e-6fd043bafa52 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:33.018790 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ae9c051b-68c1-495b-a77e-6fd043bafa52 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:33.031127 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ae9c051b-68c1-495b-a77e-6fd043bafa52 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:33.031810 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ae9c051b-68c1-495b-a77e-6fd043bafa52 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:33.032612 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ae9c051b-68c1-495b-a77e-6fd043bafa52 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:33.033046 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ae9c051b-68c1-495b-a77e-6fd043bafa52 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:33.043422 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:33.190488 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f1522c70-4590-46c9-abf1-1dfe0989e49f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:33.191273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f1522c70-4590-46c9-abf1-1dfe0989e49f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:33.203827 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1522c70-4590-46c9-abf1-1dfe0989e49f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:33.204093 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1522c70-4590-46c9-abf1-1dfe0989e49f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:33.209814 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1522c70-4590-46c9-abf1-1dfe0989e49f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:33.211258 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1522c70-4590-46c9-abf1-1dfe0989e49f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:33.283247 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ae9c051b-68c1-495b-a77e-6fd043bafa52 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:33.291369 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ae9c051b-68c1-495b-a77e-6fd043bafa52 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.278584 Jul 24 01:13:33.304243 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 126/246] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:33 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:33.429242 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f1522c70-4590-46c9-abf1-1dfe0989e49f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:33.441855 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f1522c70-4590-46c9-abf1-1dfe0989e49f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.256151 Jul 24 01:13:33.443410 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 121/247] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:33 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:34.309608 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b726563a-a3d2-48ee-b6a5-bb8baf66b516 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:34.310169 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b726563a-a3d2-48ee-b6a5-bb8baf66b516 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:34.316600 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b726563a-a3d2-48ee-b6a5-bb8baf66b516 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:34.317039 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b726563a-a3d2-48ee-b6a5-bb8baf66b516 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:34.317795 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b726563a-a3d2-48ee-b6a5-bb8baf66b516 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:34.318211 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b726563a-a3d2-48ee-b6a5-bb8baf66b516 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:34.456245 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b726563a-a3d2-48ee-b6a5-bb8baf66b516 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:34.460240 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-212508f9-d147-4114-aba0-42d5e2e6fbb8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:34.460848 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-212508f9-d147-4114-aba0-42d5e2e6fbb8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:34.464202 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b726563a-a3d2-48ee-b6a5-bb8baf66b516 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.158596 Jul 24 01:13:34.464999 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 127/248] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:34 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:34.468289 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-212508f9-d147-4114-aba0-42d5e2e6fbb8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:34.468730 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-212508f9-d147-4114-aba0-42d5e2e6fbb8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:34.469488 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-212508f9-d147-4114-aba0-42d5e2e6fbb8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:34.469911 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-212508f9-d147-4114-aba0-42d5e2e6fbb8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:34.754698 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-212508f9-d147-4114-aba0-42d5e2e6fbb8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:34.762648 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-212508f9-d147-4114-aba0-42d5e2e6fbb8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.306234 Jul 24 01:13:34.763204 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 122/249] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:34 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:35.485448 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-75e11033-60a4-48fa-800a-9d5d4ef725e3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:35.486387 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-75e11033-60a4-48fa-800a-9d5d4ef725e3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:35.495272 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-75e11033-60a4-48fa-800a-9d5d4ef725e3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:35.495757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-75e11033-60a4-48fa-800a-9d5d4ef725e3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:35.496552 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-75e11033-60a4-48fa-800a-9d5d4ef725e3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:35.496984 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-75e11033-60a4-48fa-800a-9d5d4ef725e3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:35.628936 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-75e11033-60a4-48fa-800a-9d5d4ef725e3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:35.636650 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-75e11033-60a4-48fa-800a-9d5d4ef725e3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.157708 Jul 24 01:13:35.637224 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 128/250] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:35 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:35.779787 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9463326f-5f21-4e8d-8a75-5c2477c4596d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:35.780373 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9463326f-5f21-4e8d-8a75-5c2477c4596d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:35.787598 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9463326f-5f21-4e8d-8a75-5c2477c4596d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:35.788051 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9463326f-5f21-4e8d-8a75-5c2477c4596d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:35.788850 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9463326f-5f21-4e8d-8a75-5c2477c4596d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:35.789260 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9463326f-5f21-4e8d-8a75-5c2477c4596d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:36.008032 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9463326f-5f21-4e8d-8a75-5c2477c4596d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:36.008032 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=100 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:36.013418 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9463326f-5f21-4e8d-8a75-5c2477c4596d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.237797 Jul 24 01:13:36.014254 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 123/251] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:35 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:36.653898 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ce606c50-02e3-4530-9eae-ec5875d6207d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:36.654539 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ce606c50-02e3-4530-9eae-ec5875d6207d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:36.660895 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ce606c50-02e3-4530-9eae-ec5875d6207d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:36.661315 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ce606c50-02e3-4530-9eae-ec5875d6207d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:36.662113 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ce606c50-02e3-4530-9eae-ec5875d6207d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:36.662543 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ce606c50-02e3-4530-9eae-ec5875d6207d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:36.835953 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ce606c50-02e3-4530-9eae-ec5875d6207d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:36.843788 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ce606c50-02e3-4530-9eae-ec5875d6207d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.193727 Jul 24 01:13:36.844360 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 129/252] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:36 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:37.033257 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-59782893-25c1-4725-81ea-6a9fea5ef7d7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:37.033862 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-59782893-25c1-4725-81ea-6a9fea5ef7d7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:37.041471 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-59782893-25c1-4725-81ea-6a9fea5ef7d7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:37.042356 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-59782893-25c1-4725-81ea-6a9fea5ef7d7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:37.043873 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-59782893-25c1-4725-81ea-6a9fea5ef7d7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:37.044380 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-59782893-25c1-4725-81ea-6a9fea5ef7d7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:37.194739 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-59782893-25c1-4725-81ea-6a9fea5ef7d7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:37.205907 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-59782893-25c1-4725-81ea-6a9fea5ef7d7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.177423 Jul 24 01:13:37.206472 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 124/253] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:37 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:37.860531 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f268d66d-455f-4a7f-8bce-5226ede06999 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:37.861172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f268d66d-455f-4a7f-8bce-5226ede06999 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:37.867176 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f268d66d-455f-4a7f-8bce-5226ede06999 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:37.867680 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f268d66d-455f-4a7f-8bce-5226ede06999 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:37.868438 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f268d66d-455f-4a7f-8bce-5226ede06999 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:37.868861 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f268d66d-455f-4a7f-8bce-5226ede06999 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:38.041947 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f268d66d-455f-4a7f-8bce-5226ede06999 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:38.050310 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f268d66d-455f-4a7f-8bce-5226ede06999 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.193583 Jul 24 01:13:38.051217 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 130/254] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:37 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:38.226345 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-322dd020-c037-4fec-8d91-68a92d77787e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:38.227164 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-322dd020-c037-4fec-8d91-68a92d77787e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:38.236606 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-322dd020-c037-4fec-8d91-68a92d77787e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:38.237083 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-322dd020-c037-4fec-8d91-68a92d77787e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:38.238045 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-322dd020-c037-4fec-8d91-68a92d77787e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:38.238631 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-322dd020-c037-4fec-8d91-68a92d77787e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:38.438226 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-322dd020-c037-4fec-8d91-68a92d77787e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:38.448498 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-322dd020-c037-4fec-8d91-68a92d77787e tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.229896 Jul 24 01:13:38.449885 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 125/255] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:38 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:38.874023 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-a7180305-04eb-44ab-bb7b-7bfeec3bd0b0 req-f32f0727-851a-4bd5-a77e-824fccc41bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f1a40f-b6a7-433a-8a0a-83126081a557", "tag": "d7404b6e-b96a-4369-8b9a-a904feefadaa"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:38.889827 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a7180305-04eb-44ab-bb7b-7bfeec3bd0b0 req-f32f0727-851a-4bd5-a77e-824fccc41bc6 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:38.890342 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a7180305-04eb-44ab-bb7b-7bfeec3bd0b0 req-f32f0727-851a-4bd5-a77e-824fccc41bc6 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:38.921569 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-a7180305-04eb-44ab-bb7b-7bfeec3bd0b0 req-f32f0727-851a-4bd5-a77e-824fccc41bc6 service nova] Creating event network-changed:d7404b6e-b96a-4369-8b9a-a904feefadaa for instance d1f1a40f-b6a7-433a-8a0a-83126081a557 on hv-cinder-maste Jul 24 01:13:38.936846 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-a7180305-04eb-44ab-bb7b-7bfeec3bd0b0 req-f32f0727-851a-4bd5-a77e-824fccc41bc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066587 Jul 24 01:13:38.937707 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 131/256] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:39.068957 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0874cb93-3f03-4933-91d9-aa450b83c30e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:39.069633 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0874cb93-3f03-4933-91d9-aa450b83c30e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:39.076287 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0874cb93-3f03-4933-91d9-aa450b83c30e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:39.076727 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0874cb93-3f03-4933-91d9-aa450b83c30e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:39.077501 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0874cb93-3f03-4933-91d9-aa450b83c30e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:39.077930 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0874cb93-3f03-4933-91d9-aa450b83c30e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:39.252052 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0874cb93-3f03-4933-91d9-aa450b83c30e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:39.262418 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0874cb93-3f03-4933-91d9-aa450b83c30e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.197591 Jul 24 01:13:39.263235 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 126/257] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:39 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:39.466629 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-24024fb3-4677-49f2-a6be-24601ea72218 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:39.467455 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-24024fb3-4677-49f2-a6be-24601ea72218 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:39.474054 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-24024fb3-4677-49f2-a6be-24601ea72218 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:39.480590 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-24024fb3-4677-49f2-a6be-24601ea72218 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:39.481833 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-24024fb3-4677-49f2-a6be-24601ea72218 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:39.482420 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-24024fb3-4677-49f2-a6be-24601ea72218 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:39.659599 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-24024fb3-4677-49f2-a6be-24601ea72218 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:39.668742 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-24024fb3-4677-49f2-a6be-24601ea72218 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.206283 Jul 24 01:13:39.669499 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 132/258] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:39 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:40.279350 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b7eed28c-916f-411f-a9b7-18eaa9ef64cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:40.280090 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b7eed28c-916f-411f-a9b7-18eaa9ef64cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:40.288649 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b7eed28c-916f-411f-a9b7-18eaa9ef64cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:40.291081 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b7eed28c-916f-411f-a9b7-18eaa9ef64cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:40.292267 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b7eed28c-916f-411f-a9b7-18eaa9ef64cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:40.294618 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b7eed28c-916f-411f-a9b7-18eaa9ef64cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:40.688086 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6af4ad3b-9755-41de-881b-0bb93cf28603 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:40.689376 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6af4ad3b-9755-41de-881b-0bb93cf28603 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:40.703022 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6af4ad3b-9755-41de-881b-0bb93cf28603 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:40.703860 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6af4ad3b-9755-41de-881b-0bb93cf28603 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:40.704787 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6af4ad3b-9755-41de-881b-0bb93cf28603 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:40.705461 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6af4ad3b-9755-41de-881b-0bb93cf28603 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:40.989317 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b7eed28c-916f-411f-a9b7-18eaa9ef64cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:40.997909 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b7eed28c-916f-411f-a9b7-18eaa9ef64cd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.722816 Jul 24 01:13:41.003515 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 127/259] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:40 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:41.089048 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6af4ad3b-9755-41de-881b-0bb93cf28603 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:41.096859 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6af4ad3b-9755-41de-881b-0bb93cf28603 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.414326 Jul 24 01:13:41.107923 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 133/260] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:40 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:42.020015 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f607e5af-1e45-49be-aa13-69d8b9f99a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:42.020748 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f607e5af-1e45-49be-aa13-69d8b9f99a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:42.027625 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f607e5af-1e45-49be-aa13-69d8b9f99a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:42.028148 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f607e5af-1e45-49be-aa13-69d8b9f99a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:42.029300 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f607e5af-1e45-49be-aa13-69d8b9f99a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:42.029613 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f607e5af-1e45-49be-aa13-69d8b9f99a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:42.113876 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e1f6aa95-3092-467f-bf64-686efa37a25a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:42.114483 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e1f6aa95-3092-467f-bf64-686efa37a25a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:42.125099 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e1f6aa95-3092-467f-bf64-686efa37a25a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:42.125546 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e1f6aa95-3092-467f-bf64-686efa37a25a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:42.129649 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e1f6aa95-3092-467f-bf64-686efa37a25a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:42.130104 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e1f6aa95-3092-467f-bf64-686efa37a25a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:42.213117 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f607e5af-1e45-49be-aa13-69d8b9f99a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:42.222121 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f607e5af-1e45-49be-aa13-69d8b9f99a9b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1522 microversion: 2.1 time: 0.206030 Jul 24 01:13:42.222982 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 128/261] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:42 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:42.282952 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e1f6aa95-3092-467f-bf64-686efa37a25a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:42.291009 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e1f6aa95-3092-467f-bf64-686efa37a25a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.180829 Jul 24 01:13:42.291721 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 134/262] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:42 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:43.239119 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1d7fa9c8-a9ba-4931-99e6-95647db9ce78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:43.239951 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1d7fa9c8-a9ba-4931-99e6-95647db9ce78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:43.246828 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1d7fa9c8-a9ba-4931-99e6-95647db9ce78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:43.247270 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1d7fa9c8-a9ba-4931-99e6-95647db9ce78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:43.248157 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1d7fa9c8-a9ba-4931-99e6-95647db9ce78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:43.248531 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1d7fa9c8-a9ba-4931-99e6-95647db9ce78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:43.308336 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8250dc9f-5cb4-4fad-843e-11f345c29a3f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:43.309503 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8250dc9f-5cb4-4fad-843e-11f345c29a3f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:43.315990 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8250dc9f-5cb4-4fad-843e-11f345c29a3f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:43.316415 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8250dc9f-5cb4-4fad-843e-11f345c29a3f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:43.317390 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8250dc9f-5cb4-4fad-843e-11f345c29a3f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:43.317810 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8250dc9f-5cb4-4fad-843e-11f345c29a3f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:43.424866 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1d7fa9c8-a9ba-4931-99e6-95647db9ce78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:43.433572 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1d7fa9c8-a9ba-4931-99e6-95647db9ce78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1502 microversion: 2.1 time: 0.198289 Jul 24 01:13:43.434139 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 129/263] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:43 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:43.449793 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7ffd5b21-5853-4028-91c1-ba0d02e37dbc tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:43.450438 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7ffd5b21-5853-4028-91c1-ba0d02e37dbc tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:43.456860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ffd5b21-5853-4028-91c1-ba0d02e37dbc tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:43.457301 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ffd5b21-5853-4028-91c1-ba0d02e37dbc tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:43.458051 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ffd5b21-5853-4028-91c1-ba0d02e37dbc tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:43.458481 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ffd5b21-5853-4028-91c1-ba0d02e37dbc tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:43.472536 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8250dc9f-5cb4-4fad-843e-11f345c29a3f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:43.480774 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8250dc9f-5cb4-4fad-843e-11f345c29a3f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.176224 Jul 24 01:13:43.481630 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 135/264] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:43 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:43.598005 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7ffd5b21-5853-4028-91c1-ba0d02e37dbc tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:43.606168 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7ffd5b21-5853-4028-91c1-ba0d02e37dbc tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1514 microversion: 2.1 time: 0.160243 Jul 24 01:13:43.606720 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 130/265] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:43 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:44.499926 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9c5e54b5-e7e6-4c7c-9151-2b98fd327923 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:44.500704 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9c5e54b5-e7e6-4c7c-9151-2b98fd327923 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:44.507391 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c5e54b5-e7e6-4c7c-9151-2b98fd327923 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:44.507895 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c5e54b5-e7e6-4c7c-9151-2b98fd327923 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:44.508674 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c5e54b5-e7e6-4c7c-9151-2b98fd327923 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:44.509114 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c5e54b5-e7e6-4c7c-9151-2b98fd327923 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:44.645736 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9c5e54b5-e7e6-4c7c-9151-2b98fd327923 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:44.653710 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9c5e54b5-e7e6-4c7c-9151-2b98fd327923 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.158612 Jul 24 01:13:44.654381 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 136/266] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:44 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:45.011246 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-876dc2da-865e-4a70-825d-b11959692a97 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:45.013169 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-876dc2da-865e-4a70-825d-b11959692a97 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:45.020717 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-876dc2da-865e-4a70-825d-b11959692a97 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:45.021296 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-876dc2da-865e-4a70-825d-b11959692a97 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:45.022063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-876dc2da-865e-4a70-825d-b11959692a97 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:45.022920 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-876dc2da-865e-4a70-825d-b11959692a97 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:45.049242 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-876dc2da-865e-4a70-825d-b11959692a97 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lazy-loading 'flavor' on Instance uuid 266d103a-6114-42ba-a840-13096deab642 {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:45.150369 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-876dc2da-865e-4a70-825d-b11959692a97 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642/action" status: 200 len: 32 microversion: 2.1 time: 0.145604 Jul 24 01:13:45.151547 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 131/267] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:13:45 2022] POST /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:45.163149 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6ee9012c-d3ed-491e-b360-da179320debd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:45.176705 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6ee9012c-d3ed-491e-b360-da179320debd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:45.183418 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6ee9012c-d3ed-491e-b360-da179320debd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:45.183864 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6ee9012c-d3ed-491e-b360-da179320debd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:45.184625 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6ee9012c-d3ed-491e-b360-da179320debd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:45.185051 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6ee9012c-d3ed-491e-b360-da179320debd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:45.335457 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6ee9012c-d3ed-491e-b360-da179320debd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:45.344871 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6ee9012c-d3ed-491e-b360-da179320debd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.187241 Jul 24 01:13:45.345611 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 137/268] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:45 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:45.670610 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-57024169-44b0-4ea4-b9f6-fa6fa9503447 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:45.671337 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-57024169-44b0-4ea4-b9f6-fa6fa9503447 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:45.677880 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57024169-44b0-4ea4-b9f6-fa6fa9503447 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:45.678314 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57024169-44b0-4ea4-b9f6-fa6fa9503447 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:45.679345 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57024169-44b0-4ea4-b9f6-fa6fa9503447 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:45.680023 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57024169-44b0-4ea4-b9f6-fa6fa9503447 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:45.861787 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-57024169-44b0-4ea4-b9f6-fa6fa9503447 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:45.873235 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-57024169-44b0-4ea4-b9f6-fa6fa9503447 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.204623 Jul 24 01:13:45.873235 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 132/269] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:45 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:46.363960 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c4e39df0-6d28-484b-bfaf-e8556da40967 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:46.365405 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c4e39df0-6d28-484b-bfaf-e8556da40967 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:46.373566 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:46.376350 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c4e39df0-6d28-484b-bfaf-e8556da40967 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:46.377694 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c4e39df0-6d28-484b-bfaf-e8556da40967 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:46.379542 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c4e39df0-6d28-484b-bfaf-e8556da40967 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:46.380209 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c4e39df0-6d28-484b-bfaf-e8556da40967 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:46.566189 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c4e39df0-6d28-484b-bfaf-e8556da40967 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:46.574766 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c4e39df0-6d28-484b-bfaf-e8556da40967 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.216088 Jul 24 01:13:46.575379 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 138/270] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:46 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:46.889268 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-cb22b8f7-d5b3-48df-a1b6-bab461ee4df7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:46.889758 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-cb22b8f7-d5b3-48df-a1b6-bab461ee4df7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:46.903375 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cb22b8f7-d5b3-48df-a1b6-bab461ee4df7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:46.904336 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cb22b8f7-d5b3-48df-a1b6-bab461ee4df7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:46.905937 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cb22b8f7-d5b3-48df-a1b6-bab461ee4df7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:46.906615 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cb22b8f7-d5b3-48df-a1b6-bab461ee4df7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:47.096750 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-cb22b8f7-d5b3-48df-a1b6-bab461ee4df7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:47.109049 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-cb22b8f7-d5b3-48df-a1b6-bab461ee4df7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.221777 Jul 24 01:13:47.109049 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 133/271] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:46 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:47.593437 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c7a0c085-be26-430a-8546-6136d0569645 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:47.594590 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c7a0c085-be26-430a-8546-6136d0569645 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:47.605570 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7a0c085-be26-430a-8546-6136d0569645 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:47.606027 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7a0c085-be26-430a-8546-6136d0569645 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:47.610106 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7a0c085-be26-430a-8546-6136d0569645 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:47.610554 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c7a0c085-be26-430a-8546-6136d0569645 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:47.785547 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c7a0c085-be26-430a-8546-6136d0569645 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:47.794475 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c7a0c085-be26-430a-8546-6136d0569645 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.205365 Jul 24 01:13:47.795662 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 139/272] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:47 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:48.127445 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7931d3c1-5fa6-470c-85d5-b60cb815b237 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:48.128338 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7931d3c1-5fa6-470c-85d5-b60cb815b237 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:48.136934 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7931d3c1-5fa6-470c-85d5-b60cb815b237 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:48.137383 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7931d3c1-5fa6-470c-85d5-b60cb815b237 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:48.138153 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7931d3c1-5fa6-470c-85d5-b60cb815b237 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:48.138589 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7931d3c1-5fa6-470c-85d5-b60cb815b237 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:48.276981 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7931d3c1-5fa6-470c-85d5-b60cb815b237 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:48.285223 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7931d3c1-5fa6-470c-85d5-b60cb815b237 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.164693 Jul 24 01:13:48.285808 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 134/273] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:48 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:48.817578 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-44183883", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "networks": [{"uuid": "d4d39d43-febf-43f7-9d96-40b71cf4fee5"}]}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:48.819918 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5dab73d3-06ff-42fc-9470-ce86cc30527c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:48.820687 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5dab73d3-06ff-42fc-9470-ce86cc30527c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:48.827164 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5dab73d3-06ff-42fc-9470-ce86cc30527c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:48.827621 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5dab73d3-06ff-42fc-9470-ce86cc30527c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:48.828377 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5dab73d3-06ff-42fc-9470-ce86cc30527c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:48.828803 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5dab73d3-06ff-42fc-9470-ce86cc30527c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:48.875584 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.network.neutron [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] validate_networks() for [('d4d39d43-febf-43f7-9d96-40b71cf4fee5', None, None, None, None, None)] {{(pid=118035) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:13:49.054608 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5dab73d3-06ff-42fc-9470-ce86cc30527c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:49.063689 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5dab73d3-06ff-42fc-9470-ce86cc30527c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.254995 Jul 24 01:13:49.064300 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 140/274] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:48 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:49.069611 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-690662331", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "networks": [{"uuid": "469c843f-e4a2-42fa-a196-84a5267ce3c8"}]}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:49.123430 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] validate_networks() for [('469c843f-e4a2-42fa-a196-84a5267ce3c8', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:13:49.409578 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Flavor limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:13:49.410118 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Image limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:13:49.410843 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Flavor pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:13:49.411398 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Image pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:13:49.411887 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:13:49.424852 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.425299 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.426105 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.426541 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.444131 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Getting quotas for project eeb22bb3227a42cd8cce008519e7f870. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:49.448344 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Getting quotas for user b7e654fe35564c52878bc60880954dde and project eeb22bb3227a42cd8cce008519e7f870. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:49.460251 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Going to run 1 instances... {{(pid=118035) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:13:49.462545 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118035) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:13:49.512020 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-17389029-1cb5-4bbb-befb-efa07e43a6ea tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698270 Jul 24 01:13:49.513276 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 135/275] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:13:49.518264 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6b93a648-e1e6-430d-82c0-2dab3ad2c991 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:49.519250 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6b93a648-e1e6-430d-82c0-2dab3ad2c991 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:49.530458 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6b93a648-e1e6-430d-82c0-2dab3ad2c991 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.531169 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6b93a648-e1e6-430d-82c0-2dab3ad2c991 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.532033 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6b93a648-e1e6-430d-82c0-2dab3ad2c991 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.532505 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6b93a648-e1e6-430d-82c0-2dab3ad2c991 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.729955 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:13:49.730364 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:13:49.730826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:13:49.731221 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:13:49.731826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:13:49.750842 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.751283 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.752162 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.755450 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.775148 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Getting quotas for project f939fe11bf294c2e92ed1f8e9c5d43e2. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:49.779422 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Getting quotas for user b6e93b46abca4638a2c5ca6615c8972a and project f939fe11bf294c2e92ed1f8e9c5d43e2. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:49.790879 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6b93a648-e1e6-430d-82c0-2dab3ad2c991 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:49.793054 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:13:49.799546 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:13:49.799825 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6b93a648-e1e6-430d-82c0-2dab3ad2c991 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.284185 Jul 24 01:13:49.799825 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 136/276] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:49 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:49.804791 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-cb07f0f7-735b-4e68-9a90-4df62e61d0f2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:49.805428 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-cb07f0f7-735b-4e68-9a90-4df62e61d0f2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:49.850209 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7b0c035b-bbc9-4392-8920-ebda800535c6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.784855 Jul 24 01:13:49.851032 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 141/277] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:13:49.855831 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-5c8c03dd-072c-44d7-adcd-7a9c9573abcb req-b00986a1-c633-4dc4-a42a-824ba09b35e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f1a40f-b6a7-433a-8a0a-83126081a557", "name": "network-vif-plugged", "status": "completed", "tag": "d7404b6e-b96a-4369-8b9a-a904feefadaa"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:49.866505 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-5c8c03dd-072c-44d7-adcd-7a9c9573abcb req-b00986a1-c633-4dc4-a42a-824ba09b35e8 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.866861 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-5c8c03dd-072c-44d7-adcd-7a9c9573abcb req-b00986a1-c633-4dc4-a42a-824ba09b35e8 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.881838 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-5c8c03dd-072c-44d7-adcd-7a9c9573abcb req-b00986a1-c633-4dc4-a42a-824ba09b35e8 service nova] Creating event network-vif-plugged:d7404b6e-b96a-4369-8b9a-a904feefadaa for instance d1f1a40f-b6a7-433a-8a0a-83126081a557 on hv-cinder-maste Jul 24 01:13:49.881960 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-cb07f0f7-735b-4e68-9a90-4df62e61d0f2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:49.888744 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-5c8c03dd-072c-44d7-adcd-7a9c9573abcb req-b00986a1-c633-4dc4-a42a-824ba09b35e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036011 Jul 24 01:13:49.889451 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 142/278] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:49.893013 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-cb07f0f7-735b-4e68-9a90-4df62e61d0f2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1212 microversion: 2.1 time: 0.089526 Jul 24 01:13:49.893600 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 137/279] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:49 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:49.894851 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-eb70c861-07ed-4027-8192-4bd38b623e68 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:49.895557 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-eb70c861-07ed-4027-8192-4bd38b623e68 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:49.980385 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-eb70c861-07ed-4027-8192-4bd38b623e68 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:50.000591 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-eb70c861-07ed-4027-8192-4bd38b623e68 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1218 microversion: 2.1 time: 0.109615 Jul 24 01:13:50.001631 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 143/280] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:49 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:50.081181 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-daef95f0-97f4-4056-8d4b-3d5cac338e0e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:50.082078 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-daef95f0-97f4-4056-8d4b-3d5cac338e0e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:50.088979 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-daef95f0-97f4-4056-8d4b-3d5cac338e0e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:50.089697 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-daef95f0-97f4-4056-8d4b-3d5cac338e0e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:50.090774 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-daef95f0-97f4-4056-8d4b-3d5cac338e0e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:50.091430 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-daef95f0-97f4-4056-8d4b-3d5cac338e0e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:50.311360 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-daef95f0-97f4-4056-8d4b-3d5cac338e0e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:50.321129 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-daef95f0-97f4-4056-8d4b-3d5cac338e0e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.243781 Jul 24 01:13:50.321734 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 138/281] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:50 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:50.815839 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d5cee065-d6f0-485f-8256-493e61f26fc8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:50.816652 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d5cee065-d6f0-485f-8256-493e61f26fc8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:50.823171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d5cee065-d6f0-485f-8256-493e61f26fc8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:50.823648 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d5cee065-d6f0-485f-8256-493e61f26fc8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:50.824414 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d5cee065-d6f0-485f-8256-493e61f26fc8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:50.824846 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d5cee065-d6f0-485f-8256-493e61f26fc8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:50.912977 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6f5e7054-44c6-449b-a490-ee429c79649e tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:50.913626 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6f5e7054-44c6-449b-a490-ee429c79649e tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:50.921647 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f5e7054-44c6-449b-a490-ee429c79649e tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:50.922128 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f5e7054-44c6-449b-a490-ee429c79649e tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:50.922945 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f5e7054-44c6-449b-a490-ee429c79649e tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:50.923411 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f5e7054-44c6-449b-a490-ee429c79649e tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:50.972483 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d5cee065-d6f0-485f-8256-493e61f26fc8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:50.980919 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d5cee065-d6f0-485f-8256-493e61f26fc8 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.168936 Jul 24 01:13:50.990138 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 144/282] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:50 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:51.002488 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6f5e7054-44c6-449b-a490-ee429c79649e tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:51.010337 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6f5e7054-44c6-449b-a490-ee429c79649e tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1264 microversion: 2.1 time: 0.101327 Jul 24 01:13:51.010910 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 139/283] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:50 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1264 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:51.017849 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a0071a23-a087-40aa-8597-7d1a369141ef tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:51.018466 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a0071a23-a087-40aa-8597-7d1a369141ef tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:51.024682 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a0071a23-a087-40aa-8597-7d1a369141ef tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:51.025131 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a0071a23-a087-40aa-8597-7d1a369141ef tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:51.025892 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a0071a23-a087-40aa-8597-7d1a369141ef tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:51.026322 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a0071a23-a087-40aa-8597-7d1a369141ef tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:51.091550 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a0071a23-a087-40aa-8597-7d1a369141ef tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:51.095145 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=100 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:51.099455 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a0071a23-a087-40aa-8597-7d1a369141ef tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1214 microversion: 2.1 time: 0.085558 Jul 24 01:13:51.100023 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 145/284] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:51 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:51.340078 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3861e002-f918-4f9e-b57d-aa9138de2102 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:51.340603 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3861e002-f918-4f9e-b57d-aa9138de2102 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:51.350161 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3861e002-f918-4f9e-b57d-aa9138de2102 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:51.350611 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3861e002-f918-4f9e-b57d-aa9138de2102 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:51.351797 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3861e002-f918-4f9e-b57d-aa9138de2102 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:51.352450 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3861e002-f918-4f9e-b57d-aa9138de2102 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:51.356472 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:51.487444 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3861e002-f918-4f9e-b57d-aa9138de2102 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:51.495475 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3861e002-f918-4f9e-b57d-aa9138de2102 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.160213 Jul 24 01:13:51.496032 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 140/285] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:51 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:51.998756 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c9edb184-9bb4-456f-8f60-7ac2f9568941 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:51.999451 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c9edb184-9bb4-456f-8f60-7ac2f9568941 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:52.006145 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c9edb184-9bb4-456f-8f60-7ac2f9568941 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.006591 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c9edb184-9bb4-456f-8f60-7ac2f9568941 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.007383 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c9edb184-9bb4-456f-8f60-7ac2f9568941 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.007811 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c9edb184-9bb4-456f-8f60-7ac2f9568941 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.028341 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e89a441c-1d01-4538-8fb4-fc19307fc1b9 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:52.029055 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e89a441c-1d01-4538-8fb4-fc19307fc1b9 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:52.035512 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e89a441c-1d01-4538-8fb4-fc19307fc1b9 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.036039 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e89a441c-1d01-4538-8fb4-fc19307fc1b9 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.036879 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e89a441c-1d01-4538-8fb4-fc19307fc1b9 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.037422 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e89a441c-1d01-4538-8fb4-fc19307fc1b9 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.125104 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e89a441c-1d01-4538-8fb4-fc19307fc1b9 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:52.146880 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e89a441c-1d01-4538-8fb4-fc19307fc1b9 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1264 microversion: 2.1 time: 0.120499 Jul 24 01:13:52.146880 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 141/286] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:52 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1264 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:52.151241 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-fa119e1e-b585-44bd-b63c-cc4ffc7c43e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:52.151976 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-fa119e1e-b585-44bd-b63c-cc4ffc7c43e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:52.159365 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fa119e1e-b585-44bd-b63c-cc4ffc7c43e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.160343 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fa119e1e-b585-44bd-b63c-cc4ffc7c43e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.161834 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fa119e1e-b585-44bd-b63c-cc4ffc7c43e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.161952 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fa119e1e-b585-44bd-b63c-cc4ffc7c43e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.222464 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c9edb184-9bb4-456f-8f60-7ac2f9568941 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:52.231690 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c9edb184-9bb4-456f-8f60-7ac2f9568941 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1358 microversion: 2.1 time: 0.237221 Jul 24 01:13:52.232306 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 146/287] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:51 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:52.238290 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-fa119e1e-b585-44bd-b63c-cc4ffc7c43e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:52.246106 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-fa119e1e-b585-44bd-b63c-cc4ffc7c43e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1214 microversion: 2.1 time: 0.099115 Jul 24 01:13:52.246673 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 142/288] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:52 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:52.513518 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-276249a5-be24-4276-b6ae-1aa4c5a9c150 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:52.514083 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-276249a5-be24-4276-b6ae-1aa4c5a9c150 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:52.522627 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-276249a5-be24-4276-b6ae-1aa4c5a9c150 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.523089 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-276249a5-be24-4276-b6ae-1aa4c5a9c150 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.523940 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-276249a5-be24-4276-b6ae-1aa4c5a9c150 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.524385 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-276249a5-be24-4276-b6ae-1aa4c5a9c150 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.658609 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-276249a5-be24-4276-b6ae-1aa4c5a9c150 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:52.668220 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-276249a5-be24-4276-b6ae-1aa4c5a9c150 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.158922 Jul 24 01:13:52.669123 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 147/289] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:52 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:53.162295 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e5816f7c-3766-46ce-8ce1-6de128978ba4 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:53.163038 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e5816f7c-3766-46ce-8ce1-6de128978ba4 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:53.170131 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e5816f7c-3766-46ce-8ce1-6de128978ba4 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.170726 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e5816f7c-3766-46ce-8ce1-6de128978ba4 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.171730 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e5816f7c-3766-46ce-8ce1-6de128978ba4 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.172231 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e5816f7c-3766-46ce-8ce1-6de128978ba4 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.248747 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6da57f8f-7017-401a-be79-0069322b325f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:53.249385 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6da57f8f-7017-401a-be79-0069322b325f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:53.255785 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6da57f8f-7017-401a-be79-0069322b325f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.256262 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6da57f8f-7017-401a-be79-0069322b325f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.257101 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6da57f8f-7017-401a-be79-0069322b325f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.257730 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6da57f8f-7017-401a-be79-0069322b325f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.259511 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e5816f7c-3766-46ce-8ce1-6de128978ba4 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:53.269834 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e5816f7c-3766-46ce-8ce1-6de128978ba4 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1270 microversion: 2.1 time: 0.111658 Jul 24 01:13:53.279722 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 143/290] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:53 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:53.284761 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6381a8ed-a1f6-4e83-b153-9a7f0b92ef90 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:53.285463 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6381a8ed-a1f6-4e83-b153-9a7f0b92ef90 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:53.292739 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6381a8ed-a1f6-4e83-b153-9a7f0b92ef90 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.293262 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6381a8ed-a1f6-4e83-b153-9a7f0b92ef90 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.294096 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6381a8ed-a1f6-4e83-b153-9a7f0b92ef90 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.294593 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6381a8ed-a1f6-4e83-b153-9a7f0b92ef90 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.417759 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6381a8ed-a1f6-4e83-b153-9a7f0b92ef90 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:53.426916 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6381a8ed-a1f6-4e83-b153-9a7f0b92ef90 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1278 microversion: 2.1 time: 0.145992 Jul 24 01:13:53.428130 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 144/291] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:53 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:53.686684 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3bab99f8-e705-4043-817e-71139cbe4091 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:53.687480 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3bab99f8-e705-4043-817e-71139cbe4091 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:53.694105 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3bab99f8-e705-4043-817e-71139cbe4091 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.694771 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3bab99f8-e705-4043-817e-71139cbe4091 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.695849 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3bab99f8-e705-4043-817e-71139cbe4091 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.696386 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3bab99f8-e705-4043-817e-71139cbe4091 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.868439 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6da57f8f-7017-401a-be79-0069322b325f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:53.877282 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6da57f8f-7017-401a-be79-0069322b325f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1549 microversion: 2.1 time: 0.632479 Jul 24 01:13:53.891209 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 148/292] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:53 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1549 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:53.896666 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1bf44960-ef90-4e28-b655-368dbbfbbaaa tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:53.897377 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1bf44960-ef90-4e28-b655-368dbbfbbaaa tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:53.904557 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1bf44960-ef90-4e28-b655-368dbbfbbaaa tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.905073 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1bf44960-ef90-4e28-b655-368dbbfbbaaa tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.905835 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1bf44960-ef90-4e28-b655-368dbbfbbaaa tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.906272 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1bf44960-ef90-4e28-b655-368dbbfbbaaa tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.068977 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3bab99f8-e705-4043-817e-71139cbe4091 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:54.079018 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3bab99f8-e705-4043-817e-71139cbe4091 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.396588 Jul 24 01:13:54.079663 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 145/293] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:53 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:54.243197 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1bf44960-ef90-4e28-b655-368dbbfbbaaa tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:54.252051 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1bf44960-ef90-4e28-b655-368dbbfbbaaa tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1549 microversion: 2.1 time: 0.359286 Jul 24 01:13:54.253555 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 149/294] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:53 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1549 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:54.269512 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f9793476-a23b-4b60-bfb1-ad570eb24e04 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:54.272973 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f9793476-a23b-4b60-bfb1-ad570eb24e04 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:54.273739 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f9793476-a23b-4b60-bfb1-ad570eb24e04 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Searching by: {'deleted': False, 'project_id': '083e6e1f36c3453da2befa06a4875014'} {{(pid=118035) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:13:54.280828 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9793476-a23b-4b60-bfb1-ad570eb24e04 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:54.281521 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9793476-a23b-4b60-bfb1-ad570eb24e04 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.282505 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9793476-a23b-4b60-bfb1-ad570eb24e04 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:54.282941 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9793476-a23b-4b60-bfb1-ad570eb24e04 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.286796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-fa80ac8e-4c89-4fba-a5ca-2f4d74feda91 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:54.287499 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-fa80ac8e-4c89-4fba-a5ca-2f4d74feda91 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:54.293753 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fa80ac8e-4c89-4fba-a5ca-2f4d74feda91 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:54.294438 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fa80ac8e-4c89-4fba-a5ca-2f4d74feda91 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.295430 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fa80ac8e-4c89-4fba-a5ca-2f4d74feda91 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:54.295976 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fa80ac8e-4c89-4fba-a5ca-2f4d74feda91 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.380222 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.multi_cell_list [None req-f9793476-a23b-4b60-bfb1-ad570eb24e04 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118035) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:13:54.478467 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f9793476-a23b-4b60-bfb1-ad570eb24e04 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213098 Jul 24 01:13:54.479051 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 146/295] 10.222.0.42 () {58 vars in 1124 bytes} [Sun Jul 24 01:13:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:54.483790 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-af9b5c15-8783-499d-a30e-cca61fbdc42e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:54.484410 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-af9b5c15-8783-499d-a30e-cca61fbdc42e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:54.490500 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-af9b5c15-8783-499d-a30e-cca61fbdc42e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:54.490946 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-af9b5c15-8783-499d-a30e-cca61fbdc42e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.491737 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-af9b5c15-8783-499d-a30e-cca61fbdc42e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:54.492511 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-af9b5c15-8783-499d-a30e-cca61fbdc42e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.597357 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-af9b5c15-8783-499d-a30e-cca61fbdc42e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:54.605156 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-af9b5c15-8783-499d-a30e-cca61fbdc42e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1276 microversion: 2.1 time: 0.125055 Jul 24 01:13:54.605727 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 147/296] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:54 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:54.615696 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a6879224-9994-4b44-8563-569ead402403 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:54.615696 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a6879224-9994-4b44-8563-569ead402403 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:54.616820 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a6879224-9994-4b44-8563-569ead402403 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:54.617262 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a6879224-9994-4b44-8563-569ead402403 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.617904 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-fa80ac8e-4c89-4fba-a5ca-2f4d74feda91 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:54.618073 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a6879224-9994-4b44-8563-569ead402403 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:54.618535 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a6879224-9994-4b44-8563-569ead402403 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.629379 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-fa80ac8e-4c89-4fba-a5ca-2f4d74feda91 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.346340 Jul 24 01:13:54.630745 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 150/297] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:54 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:54.933317 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a6879224-9994-4b44-8563-569ead402403 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:54.940918 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a6879224-9994-4b44-8563-569ead402403 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1549 microversion: 2.1 time: 0.334217 Jul 24 01:13:54.941484 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 148/298] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:54 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1549 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:55.097040 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0866b994-aea3-4c41-82c5-f4734a2e7ae9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:55.097863 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0866b994-aea3-4c41-82c5-f4734a2e7ae9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:55.104852 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0866b994-aea3-4c41-82c5-f4734a2e7ae9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:55.105332 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0866b994-aea3-4c41-82c5-f4734a2e7ae9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:55.106236 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0866b994-aea3-4c41-82c5-f4734a2e7ae9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:55.106469 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0866b994-aea3-4c41-82c5-f4734a2e7ae9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:55.406763 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-0866b994-aea3-4c41-82c5-f4734a2e7ae9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:55.415020 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0866b994-aea3-4c41-82c5-f4734a2e7ae9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.322145 Jul 24 01:13:55.415792 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 151/299] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:55 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:55.623181 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-818c7cbf-38c0-4070-b7df-aee2f204845f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:55.623916 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-818c7cbf-38c0-4070-b7df-aee2f204845f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:55.630840 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-818c7cbf-38c0-4070-b7df-aee2f204845f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:55.631206 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-818c7cbf-38c0-4070-b7df-aee2f204845f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:55.632036 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-818c7cbf-38c0-4070-b7df-aee2f204845f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:55.632520 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-818c7cbf-38c0-4070-b7df-aee2f204845f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:55.647620 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b8a2d846-515a-45ac-abed-4d4e260f9da3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:55.648579 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b8a2d846-515a-45ac-abed-4d4e260f9da3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:55.654985 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b8a2d846-515a-45ac-abed-4d4e260f9da3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:55.655599 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b8a2d846-515a-45ac-abed-4d4e260f9da3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:55.656468 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b8a2d846-515a-45ac-abed-4d4e260f9da3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:55.657171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b8a2d846-515a-45ac-abed-4d4e260f9da3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:56.018225 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-818c7cbf-38c0-4070-b7df-aee2f204845f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:56.026027 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-818c7cbf-38c0-4070-b7df-aee2f204845f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.407504 Jul 24 01:13:56.026594 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 149/300] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:55 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:56.035336 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-c7696937-0a7d-4ef3-b9e0-b23a6a303fe2 req-c6c2285a-79c9-46f8-adf5-b32f85b73053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6ddd6a-fc62-4071-8343-fd371ac2b857", "tag": "7648f11b-85dc-4114-aa30-70e02c45ae4e"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:56.039044 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-c7696937-0a7d-4ef3-b9e0-b23a6a303fe2 req-c6c2285a-79c9-46f8-adf5-b32f85b73053 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:56.039337 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-c7696937-0a7d-4ef3-b9e0-b23a6a303fe2 req-c6c2285a-79c9-46f8-adf5-b32f85b73053 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:56.051284 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-c7696937-0a7d-4ef3-b9e0-b23a6a303fe2 req-c6c2285a-79c9-46f8-adf5-b32f85b73053 service nova] Creating event network-changed:7648f11b-85dc-4114-aa30-70e02c45ae4e for instance 5e6ddd6a-fc62-4071-8343-fd371ac2b857 on hv-cinder-maste Jul 24 01:13:56.059906 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b8a2d846-515a-45ac-abed-4d4e260f9da3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:56.064866 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-c7696937-0a7d-4ef3-b9e0-b23a6a303fe2 req-c6c2285a-79c9-46f8-adf5-b32f85b73053 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037016 Jul 24 01:13:56.065473 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 150/301] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:56.068092 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b8a2d846-515a-45ac-abed-4d4e260f9da3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.424592 Jul 24 01:13:56.068623 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 152/302] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:55 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:56.437806 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-52a84347-8797-4dec-ab81-a403189a98ba tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:56.438542 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-52a84347-8797-4dec-ab81-a403189a98ba tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:56.445608 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-52a84347-8797-4dec-ab81-a403189a98ba tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:56.446119 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-52a84347-8797-4dec-ab81-a403189a98ba tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:56.446972 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-52a84347-8797-4dec-ab81-a403189a98ba tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:56.447429 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-52a84347-8797-4dec-ab81-a403189a98ba tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:56.707197 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-52a84347-8797-4dec-ab81-a403189a98ba tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:56.714920 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-52a84347-8797-4dec-ab81-a403189a98ba tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.282785 Jul 24 01:13:56.715709 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 151/303] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:56 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:57.045228 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d8e8062a-bcdd-4329-a6b4-88343aa9a8fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:57.046041 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d8e8062a-bcdd-4329-a6b4-88343aa9a8fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:57.054872 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d8e8062a-bcdd-4329-a6b4-88343aa9a8fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.055524 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d8e8062a-bcdd-4329-a6b4-88343aa9a8fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.056614 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d8e8062a-bcdd-4329-a6b4-88343aa9a8fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.057146 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d8e8062a-bcdd-4329-a6b4-88343aa9a8fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.085188 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-607b9b72-21e0-4ede-bb84-60806e5f621c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:57.085914 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-607b9b72-21e0-4ede-bb84-60806e5f621c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:57.087921 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:57.093471 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-607b9b72-21e0-4ede-bb84-60806e5f621c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.093917 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-607b9b72-21e0-4ede-bb84-60806e5f621c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.094681 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-607b9b72-21e0-4ede-bb84-60806e5f621c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.095107 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-607b9b72-21e0-4ede-bb84-60806e5f621c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.242684 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d8e8062a-bcdd-4329-a6b4-88343aa9a8fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:57.250423 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d8e8062a-bcdd-4329-a6b4-88343aa9a8fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.210853 Jul 24 01:13:57.250989 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 153/304] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:57 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:57.269228 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-607b9b72-21e0-4ede-bb84-60806e5f621c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:57.276970 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-607b9b72-21e0-4ede-bb84-60806e5f621c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.195781 Jul 24 01:13:57.277533 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 152/305] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:57 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:57.558129 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e303c5c4-9914-4306-9320-ed684b38f2ce tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93281ab6-e676-4c4f-9652-ef0ebb7f71fd"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:57.559327 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e303c5c4-9914-4306-9320-ed684b38f2ce tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:57.566276 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e303c5c4-9914-4306-9320-ed684b38f2ce tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.566760 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e303c5c4-9914-4306-9320-ed684b38f2ce tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.567831 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e303c5c4-9914-4306-9320-ed684b38f2ce tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.568432 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e303c5c4-9914-4306-9320-ed684b38f2ce tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.736690 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8cef4614-8e02-49dd-a4fb-d4079505338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:57.737500 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8cef4614-8e02-49dd-a4fb-d4079505338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:57.748705 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8cef4614-8e02-49dd-a4fb-d4079505338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.749295 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8cef4614-8e02-49dd-a4fb-d4079505338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.750446 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8cef4614-8e02-49dd-a4fb-d4079505338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.750986 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8cef4614-8e02-49dd-a4fb-d4079505338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.908873 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8cef4614-8e02-49dd-a4fb-d4079505338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:57.916551 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8cef4614-8e02-49dd-a4fb-d4079505338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.187420 Jul 24 01:13:57.917123 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 153/306] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:57 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:58.094162 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-2537eeb5-98c0-421e-985f-aff25db9c8c5 req-1e556bdf-4638-4dd6-b54a-ca26fc244e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe323e1-5672-4861-86f6-9ad130ae8559", "tag": "6df8987c-6158-4efb-8f70-f70a423a7935"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:58.103044 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-2537eeb5-98c0-421e-985f-aff25db9c8c5 req-1e556bdf-4638-4dd6-b54a-ca26fc244e6a service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.103621 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-2537eeb5-98c0-421e-985f-aff25db9c8c5 req-1e556bdf-4638-4dd6-b54a-ca26fc244e6a service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.116081 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-2537eeb5-98c0-421e-985f-aff25db9c8c5 req-1e556bdf-4638-4dd6-b54a-ca26fc244e6a service nova] Creating event network-changed:6df8987c-6158-4efb-8f70-f70a423a7935 for instance 8fe323e1-5672-4861-86f6-9ad130ae8559 on hv-cinder-maste Jul 24 01:13:58.122102 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-2537eeb5-98c0-421e-985f-aff25db9c8c5 req-1e556bdf-4638-4dd6-b54a-ca26fc244e6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031431 Jul 24 01:13:58.122676 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 154/307] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:58.271572 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c334629c-37ca-4c3b-87ea-879873004cdc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:58.272776 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c334629c-37ca-4c3b-87ea-879873004cdc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:58.280386 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c334629c-37ca-4c3b-87ea-879873004cdc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.280841 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c334629c-37ca-4c3b-87ea-879873004cdc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.281603 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c334629c-37ca-4c3b-87ea-879873004cdc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.282042 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c334629c-37ca-4c3b-87ea-879873004cdc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.419371 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c334629c-37ca-4c3b-87ea-879873004cdc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:58.427468 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c334629c-37ca-4c3b-87ea-879873004cdc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.162279 Jul 24 01:13:58.428055 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 155/308] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:58 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:58.432504 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-585c06a7-99f0-4b8f-827b-80e14773790c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:58.433084 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-585c06a7-99f0-4b8f-827b-80e14773790c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:58.439162 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-585c06a7-99f0-4b8f-827b-80e14773790c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.439540 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-585c06a7-99f0-4b8f-827b-80e14773790c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.440278 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-585c06a7-99f0-4b8f-827b-80e14773790c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.440716 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-585c06a7-99f0-4b8f-827b-80e14773790c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.574927 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-585c06a7-99f0-4b8f-827b-80e14773790c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:58.582789 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-585c06a7-99f0-4b8f-827b-80e14773790c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.153772 Jul 24 01:13:58.583386 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 156/309] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:58 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:58.938326 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0ee4421d-dd0e-467b-a60e-46f1d7377694 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:58.939385 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0ee4421d-dd0e-467b-a60e-46f1d7377694 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:58.950540 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0ee4421d-dd0e-467b-a60e-46f1d7377694 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.951289 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0ee4421d-dd0e-467b-a60e-46f1d7377694 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.952594 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0ee4421d-dd0e-467b-a60e-46f1d7377694 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.953331 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0ee4421d-dd0e-467b-a60e-46f1d7377694 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:59.326713 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0ee4421d-dd0e-467b-a60e-46f1d7377694 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:59.330259 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=100 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:59.339582 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0ee4421d-dd0e-467b-a60e-46f1d7377694 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.407790 Jul 24 01:13:59.340404 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 157/310] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:58 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:59.448319 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-732bc137-6b62-4298-bdf4-237423b991d7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:59.448929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-732bc137-6b62-4298-bdf4-237423b991d7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:59.455582 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-732bc137-6b62-4298-bdf4-237423b991d7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:59.456040 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-732bc137-6b62-4298-bdf4-237423b991d7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:59.456811 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-732bc137-6b62-4298-bdf4-237423b991d7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:59.457248 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-732bc137-6b62-4298-bdf4-237423b991d7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:59.589454 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-732bc137-6b62-4298-bdf4-237423b991d7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:59.598282 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-732bc137-6b62-4298-bdf4-237423b991d7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.156332 Jul 24 01:13:59.598887 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 158/311] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:59 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:59.603327 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-dd64a3d5-3ffe-4ba7-aa9a-093f7891e283 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:59.603922 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-dd64a3d5-3ffe-4ba7-aa9a-093f7891e283 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:59.609844 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dd64a3d5-3ffe-4ba7-aa9a-093f7891e283 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:59.610284 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dd64a3d5-3ffe-4ba7-aa9a-093f7891e283 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:59.611036 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dd64a3d5-3ffe-4ba7-aa9a-093f7891e283 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:59.611500 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dd64a3d5-3ffe-4ba7-aa9a-093f7891e283 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:59.744453 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-dd64a3d5-3ffe-4ba7-aa9a-093f7891e283 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:59.752765 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-dd64a3d5-3ffe-4ba7-aa9a-093f7891e283 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.152780 Jul 24 01:13:59.753414 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 159/312] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:59 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:59.766989 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:59.991160 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=8 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:00.355627 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-db222c76-84ab-48b4-987b-ee1443f7202a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:00.356258 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-db222c76-84ab-48b4-987b-ee1443f7202a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:00.358157 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=8 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:00.364172 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-db222c76-84ab-48b4-987b-ee1443f7202a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:00.364624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-db222c76-84ab-48b4-987b-ee1443f7202a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:00.365405 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-db222c76-84ab-48b4-987b-ee1443f7202a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:00.365838 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-db222c76-84ab-48b4-987b-ee1443f7202a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:00.451887 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e303c5c4-9914-4306-9320-ed684b38f2ce tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "POST /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.898520 Jul 24 01:14:00.452604 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 154/313] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:13:57 2022] POST /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments => generated 194 bytes in 2901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:00.617008 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-69808f9f-2b03-4b61-8768-ae595e2bb2b7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:00.617748 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-69808f9f-2b03-4b61-8768-ae595e2bb2b7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:00.625667 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-69808f9f-2b03-4b61-8768-ae595e2bb2b7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:00.626407 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-69808f9f-2b03-4b61-8768-ae595e2bb2b7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:00.628100 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-69808f9f-2b03-4b61-8768-ae595e2bb2b7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:00.628620 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-69808f9f-2b03-4b61-8768-ae595e2bb2b7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:00.650281 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-db222c76-84ab-48b4-987b-ee1443f7202a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:00.663131 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-db222c76-84ab-48b4-987b-ee1443f7202a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.311265 Jul 24 01:14:00.664217 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 160/314] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:00 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:00.770433 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b64fe4d6-b5ab-4ef1-b1a1-fa5216818850 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:00.771657 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b64fe4d6-b5ab-4ef1-b1a1-fa5216818850 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:00.780415 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b64fe4d6-b5ab-4ef1-b1a1-fa5216818850 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:00.781129 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b64fe4d6-b5ab-4ef1-b1a1-fa5216818850 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:00.782093 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b64fe4d6-b5ab-4ef1-b1a1-fa5216818850 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:00.782715 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b64fe4d6-b5ab-4ef1-b1a1-fa5216818850 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:00.959261 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-69808f9f-2b03-4b61-8768-ae595e2bb2b7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:00.967258 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-69808f9f-2b03-4b61-8768-ae595e2bb2b7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.355310 Jul 24 01:14:00.967955 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 155/315] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:00 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:01.027107 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b64fe4d6-b5ab-4ef1-b1a1-fa5216818850 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:01.035771 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b64fe4d6-b5ab-4ef1-b1a1-fa5216818850 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.269570 Jul 24 01:14:01.036387 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 161/316] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:00 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:01.681465 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1d1bad67-a2bd-48d9-b8c7-256f87e32559 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:01.682108 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1d1bad67-a2bd-48d9-b8c7-256f87e32559 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:01.689092 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1d1bad67-a2bd-48d9-b8c7-256f87e32559 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:01.689542 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1d1bad67-a2bd-48d9-b8c7-256f87e32559 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:01.690311 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1d1bad67-a2bd-48d9-b8c7-256f87e32559 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:01.690746 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1d1bad67-a2bd-48d9-b8c7-256f87e32559 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:01.968552 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1d1bad67-a2bd-48d9-b8c7-256f87e32559 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:01.978658 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1d1bad67-a2bd-48d9-b8c7-256f87e32559 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.301558 Jul 24 01:14:01.979333 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 156/317] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:01 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:01.984187 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-61035a81-f47e-4770-98ad-98ae3cea37f7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:01.984823 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-61035a81-f47e-4770-98ad-98ae3cea37f7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:01.993685 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61035a81-f47e-4770-98ad-98ae3cea37f7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:01.994323 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61035a81-f47e-4770-98ad-98ae3cea37f7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:01.995122 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61035a81-f47e-4770-98ad-98ae3cea37f7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:01.995610 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61035a81-f47e-4770-98ad-98ae3cea37f7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:02.053097 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3f86c075-aa34-4451-a8e6-2e89c82d286d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:02.053614 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3f86c075-aa34-4451-a8e6-2e89c82d286d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:02.059933 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3f86c075-aa34-4451-a8e6-2e89c82d286d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:02.060381 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3f86c075-aa34-4451-a8e6-2e89c82d286d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:02.061141 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3f86c075-aa34-4451-a8e6-2e89c82d286d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:02.061659 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3f86c075-aa34-4451-a8e6-2e89c82d286d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:02.169961 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-61035a81-f47e-4770-98ad-98ae3cea37f7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:02.179772 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-61035a81-f47e-4770-98ad-98ae3cea37f7 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.199292 Jul 24 01:14:02.180346 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 162/318] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:01 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:02.213243 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3f86c075-aa34-4451-a8e6-2e89c82d286d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:02.221038 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3f86c075-aa34-4451-a8e6-2e89c82d286d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.172236 Jul 24 01:14:02.221564 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 157/319] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:02 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:03.000127 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-69640b39-e0b6-414b-abf6-d2124532dbf2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:03.001097 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-69640b39-e0b6-414b-abf6-d2124532dbf2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:03.011202 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-69640b39-e0b6-414b-abf6-d2124532dbf2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.011691 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-69640b39-e0b6-414b-abf6-d2124532dbf2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.012454 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-69640b39-e0b6-414b-abf6-d2124532dbf2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.012891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-69640b39-e0b6-414b-abf6-d2124532dbf2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.154182 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-69640b39-e0b6-414b-abf6-d2124532dbf2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:03.162058 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-69640b39-e0b6-414b-abf6-d2124532dbf2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.168439 Jul 24 01:14:03.162600 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 163/320] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:02 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:03.196668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-905988fa-2a61-49b0-9b3b-ca880f1fe31a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:03.197346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-905988fa-2a61-49b0-9b3b-ca880f1fe31a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:03.204187 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-905988fa-2a61-49b0-9b3b-ca880f1fe31a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.204628 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-905988fa-2a61-49b0-9b3b-ca880f1fe31a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.205381 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-905988fa-2a61-49b0-9b3b-ca880f1fe31a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.205808 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-905988fa-2a61-49b0-9b3b-ca880f1fe31a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.238010 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1100eee6-fd11-4d3d-b710-6b9f3ecb3545 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:03.238626 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1100eee6-fd11-4d3d-b710-6b9f3ecb3545 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:03.245182 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1100eee6-fd11-4d3d-b710-6b9f3ecb3545 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.245630 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1100eee6-fd11-4d3d-b710-6b9f3ecb3545 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.246436 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1100eee6-fd11-4d3d-b710-6b9f3ecb3545 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.246873 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1100eee6-fd11-4d3d-b710-6b9f3ecb3545 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.385989 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-905988fa-2a61-49b0-9b3b-ca880f1fe31a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:03.393877 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-905988fa-2a61-49b0-9b3b-ca880f1fe31a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.201018 Jul 24 01:14:03.394448 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 158/321] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:03 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:03.412740 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1100eee6-fd11-4d3d-b710-6b9f3ecb3545 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:03.422886 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1100eee6-fd11-4d3d-b710-6b9f3ecb3545 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.188481 Jul 24 01:14:03.423745 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 164/322] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:03 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:03.985832 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-1cba976a-1968-470d-ba61-446d4f94a9a4 req-27b95443-c2cb-49d9-884a-f954b5f3ec5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6ddd6a-fc62-4071-8343-fd371ac2b857", "name": "network-vif-plugged", "status": "completed", "tag": "7648f11b-85dc-4114-aa30-70e02c45ae4e"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:03.997395 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-1cba976a-1968-470d-ba61-446d4f94a9a4 req-27b95443-c2cb-49d9-884a-f954b5f3ec5a service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.997832 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-1cba976a-1968-470d-ba61-446d4f94a9a4 req-27b95443-c2cb-49d9-884a-f954b5f3ec5a service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.012909 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-1cba976a-1968-470d-ba61-446d4f94a9a4 req-27b95443-c2cb-49d9-884a-f954b5f3ec5a service nova] Creating event network-vif-plugged:7648f11b-85dc-4114-aa30-70e02c45ae4e for instance 5e6ddd6a-fc62-4071-8343-fd371ac2b857 on hv-cinder-maste Jul 24 01:14:04.019622 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-1cba976a-1968-470d-ba61-446d4f94a9a4 req-27b95443-c2cb-49d9-884a-f954b5f3ec5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037239 Jul 24 01:14:04.020771 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 159/323] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:04.180355 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e7bca7d9-3bf6-4cea-9c5a-9cf4cf4134cf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:04.180957 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e7bca7d9-3bf6-4cea-9c5a-9cf4cf4134cf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:04.187952 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e7bca7d9-3bf6-4cea-9c5a-9cf4cf4134cf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:04.188405 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e7bca7d9-3bf6-4cea-9c5a-9cf4cf4134cf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.189139 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e7bca7d9-3bf6-4cea-9c5a-9cf4cf4134cf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:04.189582 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e7bca7d9-3bf6-4cea-9c5a-9cf4cf4134cf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.315197 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=4 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:04.318575 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e7bca7d9-3bf6-4cea-9c5a-9cf4cf4134cf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:04.326523 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e7bca7d9-3bf6-4cea-9c5a-9cf4cf4134cf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.150757 Jul 24 01:14:04.327095 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 165/324] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:04 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:04.416463 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-341bbc85-391b-4dcb-b9bd-6c7fd7450960 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:04.417161 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-341bbc85-391b-4dcb-b9bd-6c7fd7450960 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:04.424154 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-341bbc85-391b-4dcb-b9bd-6c7fd7450960 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:04.424594 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-341bbc85-391b-4dcb-b9bd-6c7fd7450960 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.425347 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-341bbc85-391b-4dcb-b9bd-6c7fd7450960 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:04.425774 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-341bbc85-391b-4dcb-b9bd-6c7fd7450960 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.443098 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-844c141a-e2f3-4c8f-a3e0-3f8a41783280 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:04.443756 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-844c141a-e2f3-4c8f-a3e0-3f8a41783280 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:04.450454 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-844c141a-e2f3-4c8f-a3e0-3f8a41783280 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:04.450901 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-844c141a-e2f3-4c8f-a3e0-3f8a41783280 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.451701 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-844c141a-e2f3-4c8f-a3e0-3f8a41783280 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:04.452135 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-844c141a-e2f3-4c8f-a3e0-3f8a41783280 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.621667 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-341bbc85-391b-4dcb-b9bd-6c7fd7450960 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:04.630543 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-341bbc85-391b-4dcb-b9bd-6c7fd7450960 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.220635 Jul 24 01:14:04.631114 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 160/325] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:04 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:04.631995 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-844c141a-e2f3-4c8f-a3e0-3f8a41783280 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:04.639660 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-844c141a-e2f3-4c8f-a3e0-3f8a41783280 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.200384 Jul 24 01:14:04.640337 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 166/326] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:04 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:05.347650 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c434810a-9a84-4591-bc48-e7adf49b8a48 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:05.348533 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c434810a-9a84-4591-bc48-e7adf49b8a48 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:05.356974 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c434810a-9a84-4591-bc48-e7adf49b8a48 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.357419 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c434810a-9a84-4591-bc48-e7adf49b8a48 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.358172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c434810a-9a84-4591-bc48-e7adf49b8a48 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.358602 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c434810a-9a84-4591-bc48-e7adf49b8a48 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.487840 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c434810a-9a84-4591-bc48-e7adf49b8a48 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:05.491427 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:05.496384 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c434810a-9a84-4591-bc48-e7adf49b8a48 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.155421 Jul 24 01:14:05.496960 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 161/327] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:05 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:05.650518 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a25e2a1b-8c7e-4bee-a0f7-5d86e0b31f92 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:05.651184 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a25e2a1b-8c7e-4bee-a0f7-5d86e0b31f92 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:05.658068 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a25e2a1b-8c7e-4bee-a0f7-5d86e0b31f92 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.658522 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a25e2a1b-8c7e-4bee-a0f7-5d86e0b31f92 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.659309 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a25e2a1b-8c7e-4bee-a0f7-5d86e0b31f92 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.659821 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a25e2a1b-8c7e-4bee-a0f7-5d86e0b31f92 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.662657 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4967fa48-b844-4bbb-8b53-5af03ea69020 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:05.663238 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4967fa48-b844-4bbb-8b53-5af03ea69020 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:05.670444 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4967fa48-b844-4bbb-8b53-5af03ea69020 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.670897 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4967fa48-b844-4bbb-8b53-5af03ea69020 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.671707 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4967fa48-b844-4bbb-8b53-5af03ea69020 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.672132 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4967fa48-b844-4bbb-8b53-5af03ea69020 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.856202 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a25e2a1b-8c7e-4bee-a0f7-5d86e0b31f92 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:05.859651 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4967fa48-b844-4bbb-8b53-5af03ea69020 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:05.864163 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a25e2a1b-8c7e-4bee-a0f7-5d86e0b31f92 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.219978 Jul 24 01:14:05.864736 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 167/328] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:05 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:05.868373 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4967fa48-b844-4bbb-8b53-5af03ea69020 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.210495 Jul 24 01:14:05.869053 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 162/329] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:05 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:06.516823 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-436b4b1b-20d2-43bf-a357-0cb8c9a38885 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:06.517755 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-436b4b1b-20d2-43bf-a357-0cb8c9a38885 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:06.526588 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-436b4b1b-20d2-43bf-a357-0cb8c9a38885 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.527032 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-436b4b1b-20d2-43bf-a357-0cb8c9a38885 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.527859 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-436b4b1b-20d2-43bf-a357-0cb8c9a38885 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.528286 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-436b4b1b-20d2-43bf-a357-0cb8c9a38885 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.671106 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-436b4b1b-20d2-43bf-a357-0cb8c9a38885 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:06.679183 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-436b4b1b-20d2-43bf-a357-0cb8c9a38885 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.168292 Jul 24 01:14:06.679940 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 168/330] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:06 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:06.882562 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a2ba4f51-3e04-4611-b608-76df7125b19a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:06.883951 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a2ba4f51-3e04-4611-b608-76df7125b19a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:06.885674 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c326d610-4412-4777-a610-7f05b6721f39 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:06.886395 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c326d610-4412-4777-a610-7f05b6721f39 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:06.893312 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c326d610-4412-4777-a610-7f05b6721f39 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.893835 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c326d610-4412-4777-a610-7f05b6721f39 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.894677 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c326d610-4412-4777-a610-7f05b6721f39 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.895181 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c326d610-4412-4777-a610-7f05b6721f39 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.896688 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a2ba4f51-3e04-4611-b608-76df7125b19a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.897431 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a2ba4f51-3e04-4611-b608-76df7125b19a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.898371 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a2ba4f51-3e04-4611-b608-76df7125b19a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.898959 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a2ba4f51-3e04-4611-b608-76df7125b19a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:07.095397 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c326d610-4412-4777-a610-7f05b6721f39 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:07.099400 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a2ba4f51-3e04-4611-b608-76df7125b19a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:07.103861 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c326d610-4412-4777-a610-7f05b6721f39 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.223451 Jul 24 01:14:07.104438 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 169/331] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:06 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:07.107191 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a2ba4f51-3e04-4611-b608-76df7125b19a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.229064 Jul 24 01:14:07.107940 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 163/332] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:06 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:07.696410 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-fdab416f-65de-4026-8b76-61b3d70c3348 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:07.697293 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-fdab416f-65de-4026-8b76-61b3d70c3348 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:07.706648 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fdab416f-65de-4026-8b76-61b3d70c3348 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:07.707193 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fdab416f-65de-4026-8b76-61b3d70c3348 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:07.709496 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fdab416f-65de-4026-8b76-61b3d70c3348 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:07.710133 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fdab416f-65de-4026-8b76-61b3d70c3348 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:07.852085 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-fdab416f-65de-4026-8b76-61b3d70c3348 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:07.860897 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-fdab416f-65de-4026-8b76-61b3d70c3348 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.168344 Jul 24 01:14:07.861432 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 170/333] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:07 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:08.072669 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d3d2efe5-b13e-4246-9955-cb6e0bde27c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:08.075169 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d3d2efe5-b13e-4246-9955-cb6e0bde27c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:08.097181 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3d2efe5-b13e-4246-9955-cb6e0bde27c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.097737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3d2efe5-b13e-4246-9955-cb6e0bde27c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.098633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3d2efe5-b13e-4246-9955-cb6e0bde27c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.099254 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3d2efe5-b13e-4246-9955-cb6e0bde27c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.108324 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-3b349556-3b34-4047-b6d0-2bade19ba2fb req-eeccf9d5-9d83-4dcc-ab0e-097eb5914ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe323e1-5672-4861-86f6-9ad130ae8559", "name": "network-vif-plugged", "status": "completed", "tag": "6df8987c-6158-4efb-8f70-f70a423a7935"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:08.117947 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-3b349556-3b34-4047-b6d0-2bade19ba2fb req-eeccf9d5-9d83-4dcc-ab0e-097eb5914ce8 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.118389 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-3b349556-3b34-4047-b6d0-2bade19ba2fb req-eeccf9d5-9d83-4dcc-ab0e-097eb5914ce8 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.132438 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-3b349556-3b34-4047-b6d0-2bade19ba2fb req-eeccf9d5-9d83-4dcc-ab0e-097eb5914ce8 service nova] Creating event network-vif-plugged:6df8987c-6158-4efb-8f70-f70a423a7935 for instance 8fe323e1-5672-4861-86f6-9ad130ae8559 on hv-cinder-maste Jul 24 01:14:08.137651 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-3b349556-3b34-4047-b6d0-2bade19ba2fb req-eeccf9d5-9d83-4dcc-ab0e-097eb5914ce8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033117 Jul 24 01:14:08.138622 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 171/334] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:08.143967 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-02121167-8b44-4468-bfba-9e8b6cd265e0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:08.144876 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-02121167-8b44-4468-bfba-9e8b6cd265e0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:08.151338 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-02121167-8b44-4468-bfba-9e8b6cd265e0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.151786 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-02121167-8b44-4468-bfba-9e8b6cd265e0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.152549 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-02121167-8b44-4468-bfba-9e8b6cd265e0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.152979 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-02121167-8b44-4468-bfba-9e8b6cd265e0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.298145 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d3d2efe5-b13e-4246-9955-cb6e0bde27c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:08.306973 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d3d2efe5-b13e-4246-9955-cb6e0bde27c5 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1595 microversion: 2.1 time: 0.238761 Jul 24 01:14:08.307589 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 164/335] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:08 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1595 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:08.312248 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c64c5a9e-c30a-4eb8-a25e-9d6d9f4532ca tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:08.313089 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c64c5a9e-c30a-4eb8-a25e-9d6d9f4532ca tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:08.319683 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c64c5a9e-c30a-4eb8-a25e-9d6d9f4532ca tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.320314 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c64c5a9e-c30a-4eb8-a25e-9d6d9f4532ca tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.321333 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c64c5a9e-c30a-4eb8-a25e-9d6d9f4532ca tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.321862 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c64c5a9e-c30a-4eb8-a25e-9d6d9f4532ca tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.328515 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-02121167-8b44-4468-bfba-9e8b6cd265e0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:08.338549 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-02121167-8b44-4468-bfba-9e8b6cd265e0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.198425 Jul 24 01:14:08.339169 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 172/336] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:08 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:08.457367 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c64c5a9e-c30a-4eb8-a25e-9d6d9f4532ca tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:08.465057 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c64c5a9e-c30a-4eb8-a25e-9d6d9f4532ca tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.156502 Jul 24 01:14:08.465624 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 165/337] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:08 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:08.882940 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7e5df9c7-68ce-4a1e-beab-6efd66ab59e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:08.883729 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7e5df9c7-68ce-4a1e-beab-6efd66ab59e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:08.920081 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7e5df9c7-68ce-4a1e-beab-6efd66ab59e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.920790 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7e5df9c7-68ce-4a1e-beab-6efd66ab59e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.921748 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7e5df9c7-68ce-4a1e-beab-6efd66ab59e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.922345 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7e5df9c7-68ce-4a1e-beab-6efd66ab59e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.065982 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7e5df9c7-68ce-4a1e-beab-6efd66ab59e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:09.074048 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7e5df9c7-68ce-4a1e-beab-6efd66ab59e4 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.195371 Jul 24 01:14:09.074756 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 173/338] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:08 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:09.355914 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-458f1da4-62bd-44ce-9668-66fa799091ad tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:09.356611 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-458f1da4-62bd-44ce-9668-66fa799091ad tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:09.363453 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-458f1da4-62bd-44ce-9668-66fa799091ad tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:09.363893 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-458f1da4-62bd-44ce-9668-66fa799091ad tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.364649 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-458f1da4-62bd-44ce-9668-66fa799091ad tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:09.365060 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-458f1da4-62bd-44ce-9668-66fa799091ad tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.482124 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d2b7fda1-4c25-494c-a507-4ff1ebfa33f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:09.482929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d2b7fda1-4c25-494c-a507-4ff1ebfa33f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:09.489233 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d2b7fda1-4c25-494c-a507-4ff1ebfa33f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:09.490066 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d2b7fda1-4c25-494c-a507-4ff1ebfa33f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.491077 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d2b7fda1-4c25-494c-a507-4ff1ebfa33f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:09.492586 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d2b7fda1-4c25-494c-a507-4ff1ebfa33f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.498376 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-458f1da4-62bd-44ce-9668-66fa799091ad tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:09.507150 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-458f1da4-62bd-44ce-9668-66fa799091ad tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1312 microversion: 2.1 time: 0.155121 Jul 24 01:14:09.507757 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 166/339] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:09 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:09.625160 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d2b7fda1-4c25-494c-a507-4ff1ebfa33f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:09.633329 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d2b7fda1-4c25-494c-a507-4ff1ebfa33f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.155214 Jul 24 01:14:09.633920 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 174/340] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:09 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:10.092089 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-69e8d34d-d4cb-4ce0-9a13-a5ca24e2683b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:10.093006 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-69e8d34d-d4cb-4ce0-9a13-a5ca24e2683b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:10.102103 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-69e8d34d-d4cb-4ce0-9a13-a5ca24e2683b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.103029 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-69e8d34d-d4cb-4ce0-9a13-a5ca24e2683b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.104346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-69e8d34d-d4cb-4ce0-9a13-a5ca24e2683b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.105184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-69e8d34d-d4cb-4ce0-9a13-a5ca24e2683b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.304467 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-7220ca7a-355f-48ff-8914-bf51e8b4b4c2 req-17ec6b85-0462-4397-8fe7-e31f2e7843bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f1a40f-b6a7-433a-8a0a-83126081a557", "tag": "d7404b6e-b96a-4369-8b9a-a904feefadaa"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:10.327055 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-7220ca7a-355f-48ff-8914-bf51e8b4b4c2 req-17ec6b85-0462-4397-8fe7-e31f2e7843bd service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.328113 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-7220ca7a-355f-48ff-8914-bf51e8b4b4c2 req-17ec6b85-0462-4397-8fe7-e31f2e7843bd service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.336825 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=100 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:10.338546 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-69e8d34d-d4cb-4ce0-9a13-a5ca24e2683b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:10.350673 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-7220ca7a-355f-48ff-8914-bf51e8b4b4c2 req-17ec6b85-0462-4397-8fe7-e31f2e7843bd service nova] Creating event network-changed:d7404b6e-b96a-4369-8b9a-a904feefadaa for instance d1f1a40f-b6a7-433a-8a0a-83126081a557 on hv-cinder-maste Jul 24 01:14:10.352316 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-69e8d34d-d4cb-4ce0-9a13-a5ca24e2683b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.260527 Jul 24 01:14:10.353078 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 167/341] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:10 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:10.359683 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-7220ca7a-355f-48ff-8914-bf51e8b4b4c2 req-17ec6b85-0462-4397-8fe7-e31f2e7843bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068260 Jul 24 01:14:10.360468 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 175/342] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:10.524492 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d721343a-203c-4864-a9bf-af590f477e15 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:10.525178 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d721343a-203c-4864-a9bf-af590f477e15 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:10.532152 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d721343a-203c-4864-a9bf-af590f477e15 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.532603 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d721343a-203c-4864-a9bf-af590f477e15 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.533503 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d721343a-203c-4864-a9bf-af590f477e15 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.533947 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d721343a-203c-4864-a9bf-af590f477e15 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.650794 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8eeacb72-bf89-4a2a-85a3-75abb932f059 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:10.652109 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8eeacb72-bf89-4a2a-85a3-75abb932f059 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:10.661014 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8eeacb72-bf89-4a2a-85a3-75abb932f059 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.661763 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8eeacb72-bf89-4a2a-85a3-75abb932f059 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.663026 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8eeacb72-bf89-4a2a-85a3-75abb932f059 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.663701 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8eeacb72-bf89-4a2a-85a3-75abb932f059 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.686132 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d721343a-203c-4864-a9bf-af590f477e15 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:10.694415 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d721343a-203c-4864-a9bf-af590f477e15 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1496 microversion: 2.1 time: 0.173911 Jul 24 01:14:10.695628 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 168/343] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:10 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1496 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:10.857300 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8eeacb72-bf89-4a2a-85a3-75abb932f059 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:10.866541 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8eeacb72-bf89-4a2a-85a3-75abb932f059 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.220228 Jul 24 01:14:10.867128 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 176/344] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:10 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:11.332751 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9e2c5b13-71c9-4136-9976-4707799d9fbb tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:11.333944 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9e2c5b13-71c9-4136-9976-4707799d9fbb tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:11.341493 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9e2c5b13-71c9-4136-9976-4707799d9fbb tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.342184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9e2c5b13-71c9-4136-9976-4707799d9fbb tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.343208 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9e2c5b13-71c9-4136-9976-4707799d9fbb tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.343826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9e2c5b13-71c9-4136-9976-4707799d9fbb tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.369692 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e1259941-dbf5-42be-9221-8bd90ce072c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:11.370273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e1259941-dbf5-42be-9221-8bd90ce072c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:11.377243 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e1259941-dbf5-42be-9221-8bd90ce072c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.377998 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e1259941-dbf5-42be-9221-8bd90ce072c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.379005 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e1259941-dbf5-42be-9221-8bd90ce072c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.380767 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e1259941-dbf5-42be-9221-8bd90ce072c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.383132 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9e2c5b13-71c9-4136-9976-4707799d9fbb tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Going to try to terminate instance {{(pid=118036) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:14:11.479422 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9e2c5b13-71c9-4136-9976-4707799d9fbb tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 204 len: 0 microversion: 2.1 time: 0.150363 Jul 24 01:14:11.480310 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 169/345] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:14:11 2022] DELETE /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:14:11.489736 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e8315cd9-b74b-4ae6-b012-88001d999dd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-710219624"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:11.490364 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e8315cd9-b74b-4ae6-b012-88001d999dd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:11.496799 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e8315cd9-b74b-4ae6-b012-88001d999dd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.497481 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e8315cd9-b74b-4ae6-b012-88001d999dd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.498449 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e8315cd9-b74b-4ae6-b012-88001d999dd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.498885 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e8315cd9-b74b-4ae6-b012-88001d999dd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.546723 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e1259941-dbf5-42be-9221-8bd90ce072c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:11.556456 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e1259941-dbf5-42be-9221-8bd90ce072c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1500 microversion: 2.1 time: 0.190539 Jul 24 01:14:11.557035 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 177/346] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:11 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:11.561946 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e23a20f6-408d-466e-948a-b258a9f8ef5b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:11.562555 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e23a20f6-408d-466e-948a-b258a9f8ef5b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:11.568725 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e23a20f6-408d-466e-948a-b258a9f8ef5b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.569447 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e23a20f6-408d-466e-948a-b258a9f8ef5b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.570383 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e23a20f6-408d-466e-948a-b258a9f8ef5b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.570977 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e23a20f6-408d-466e-948a-b258a9f8ef5b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.684228 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.network.security_group_api [None req-e8315cd9-b74b-4ae6-b012-88001d999dd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Adding security group 0c29fac0-945e-4a3d-8fcd-9e732c6aac13 to port d7404b6e-b96a-4369-8b9a-a904feefadaa Jul 24 01:14:11.852744 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e23a20f6-408d-466e-948a-b258a9f8ef5b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:11.861041 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e23a20f6-408d-466e-948a-b258a9f8ef5b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1502 microversion: 2.1 time: 0.302738 Jul 24 01:14:11.861709 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 178/347] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:11 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:11.866628 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7020624-0455-4347-abd0-8c438694b28f"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:11.867772 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:11.874040 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.874491 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.875248 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.875875 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.899222 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] HTTP exception thrown: Cannot 'attach_volume' instance 266d103a-6114-42ba-a840-13096deab642 while it is in vm_state rescued Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Request method failure captured: Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: POST /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642/os-volume_attachments HTTP/1.1 Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 74 Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxbBq9RVOOhAQ73ZKUuIqeXwuUdZQ3d1dWMBcEkPotAb7wLy9XlKWYf72M40cfFegazXTvNtPJ8Z7wmHfV5zleuIgL43UdUa2qMmm6xuf7JGQq2AZ7GTTqkxHJw3b_LE77Y5xI5GjCIRLWZCBl92MrXAU_Lu8PTGOWaycH1l53LR94 Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:14:11.901494 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55d33269082642989cbc18c052f07b94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55d33269082642989cbc18c052f07b94", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}] Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1b8154ce6b6b40b4959bf354ccb5c59d Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: {"volumeAttachment": {"volumeId": "c7020624-0455-4347-abd0-8c438694b28f"}} Jul 24 01:14:11.902776 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Cannot 'attach_volume' instance 266d103a-6114-42ba-a840-13096deab642 while it is in vm_state rescued Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'server_id': '266d103a-6114-42ba-a840-13096deab642', 'body': {'volumeAttachment': {'volumeId': 'c7020624-0455-4347-abd0-8c438694b28f'}}} Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 266d103a-6114-42ba-a840-13096deab642 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:11.903944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 266d103a-6114-42ba-a840-13096deab642 while it is in vm_state rescued Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:11.905364 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:11.906460 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:11.906460 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:11.906460 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 266d103a-6114-42ba-a840-13096deab642 while it is in vm_state rescued Jul 24 01:14:11.906460 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:14:11.906460 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Returning 409 to user: Cannot 'attach_volume' instance 266d103a-6114-42ba-a840-13096deab642 while it is in vm_state rescued {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:11.906460 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-52c4ac77-0e60-4d5d-bd70-09e2f474338d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040235 Jul 24 01:14:11.906460 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 179/348] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:14:11 2022] POST /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:14:11.907709 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2605fb83-a666-418a-a60c-11fcc22ba5d4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:11.908242 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-2605fb83-a666-418a-a60c-11fcc22ba5d4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:11.914015 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2605fb83-a666-418a-a60c-11fcc22ba5d4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.914457 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2605fb83-a666-418a-a60c-11fcc22ba5d4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.915209 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2605fb83-a666-418a-a60c-11fcc22ba5d4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.915729 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2605fb83-a666-418a-a60c-11fcc22ba5d4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.361811 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2605fb83-a666-418a-a60c-11fcc22ba5d4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:12.377120 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2605fb83-a666-418a-a60c-11fcc22ba5d4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.472458 Jul 24 01:14:12.386773 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 180/349] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:11 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:12.392265 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-970de75f-face-49f4-b958-964231538d63 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:12.392890 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-970de75f-face-49f4-b958-964231538d63 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:12.400359 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-970de75f-face-49f4-b958-964231538d63 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.400891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-970de75f-face-49f4-b958-964231538d63 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.402418 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-970de75f-face-49f4-b958-964231538d63 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.403073 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-970de75f-face-49f4-b958-964231538d63 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.431233 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e8315cd9-b74b-4ae6-b012-88001d999dd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "POST /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/action" status: 202 len: 0 microversion: 2.1 time: 0.945884 Jul 24 01:14:12.432872 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 170/350] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:14:11 2022] POST /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/action => generated 0 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:12.441965 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-78b31027-8d6b-4574-9be6-453c7d1c536c req-c6cff38e-d3b2-4aa4-960a-9f7a2cd37f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f1a40f-b6a7-433a-8a0a-83126081a557", "tag": "d7404b6e-b96a-4369-8b9a-a904feefadaa"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:12.461720 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-78b31027-8d6b-4574-9be6-453c7d1c536c req-c6cff38e-d3b2-4aa4-960a-9f7a2cd37f42 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.462557 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-78b31027-8d6b-4574-9be6-453c7d1c536c req-c6cff38e-d3b2-4aa4-960a-9f7a2cd37f42 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.484639 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-78b31027-8d6b-4574-9be6-453c7d1c536c req-c6cff38e-d3b2-4aa4-960a-9f7a2cd37f42 service nova] Creating event network-changed:d7404b6e-b96a-4369-8b9a-a904feefadaa for instance d1f1a40f-b6a7-433a-8a0a-83126081a557 on hv-cinder-maste Jul 24 01:14:12.497354 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-78b31027-8d6b-4574-9be6-453c7d1c536c req-c6cff38e-d3b2-4aa4-960a-9f7a2cd37f42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059470 Jul 24 01:14:12.498399 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 171/351] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:12.506712 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2eecfe95-81f3-40a9-a48a-e36ba8e3dd14 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:12.507818 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2eecfe95-81f3-40a9-a48a-e36ba8e3dd14 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:12.517129 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2eecfe95-81f3-40a9-a48a-e36ba8e3dd14 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.518035 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2eecfe95-81f3-40a9-a48a-e36ba8e3dd14 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.519138 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2eecfe95-81f3-40a9-a48a-e36ba8e3dd14 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.519813 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2eecfe95-81f3-40a9-a48a-e36ba8e3dd14 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.530634 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-970de75f-face-49f4-b958-964231538d63 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642/action" status: 202 len: 0 microversion: 2.1 time: 0.141920 Jul 24 01:14:12.531648 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 181/352] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:14:12 2022] POST /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:12.542554 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7a6fe15f-ae50-4063-8bd1-ec46c4488f27 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:12.543551 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7a6fe15f-ae50-4063-8bd1-ec46c4488f27 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:12.552878 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7a6fe15f-ae50-4063-8bd1-ec46c4488f27 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.553789 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7a6fe15f-ae50-4063-8bd1-ec46c4488f27 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.555156 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7a6fe15f-ae50-4063-8bd1-ec46c4488f27 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.555938 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7a6fe15f-ae50-4063-8bd1-ec46c4488f27 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.762900 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2eecfe95-81f3-40a9-a48a-e36ba8e3dd14 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:12.773398 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2eecfe95-81f3-40a9-a48a-e36ba8e3dd14 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1641 microversion: 2.1 time: 0.273477 Jul 24 01:14:12.774148 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 172/353] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:12 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1641 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:12.780410 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7a6fe15f-ae50-4063-8bd1-ec46c4488f27 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:12.790520 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7a6fe15f-ae50-4063-8bd1-ec46c4488f27 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1508 microversion: 2.1 time: 0.254062 Jul 24 01:14:12.791317 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 182/354] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:12 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:12.878172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b2374938-c86a-4157-b7f2-7f874e014989 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:12.878784 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b2374938-c86a-4157-b7f2-7f874e014989 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:12.885192 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b2374938-c86a-4157-b7f2-7f874e014989 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.885686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b2374938-c86a-4157-b7f2-7f874e014989 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.886414 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b2374938-c86a-4157-b7f2-7f874e014989 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.886838 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b2374938-c86a-4157-b7f2-7f874e014989 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.024122 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b2374938-c86a-4157-b7f2-7f874e014989 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:13.031963 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b2374938-c86a-4157-b7f2-7f874e014989 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1502 microversion: 2.1 time: 0.157768 Jul 24 01:14:13.032559 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 173/355] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:12 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:13.398366 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4078c5b9-b2d5-4fc7-a978-6cdb20a649fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:13.399425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4078c5b9-b2d5-4fc7-a978-6cdb20a649fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:13.406673 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4078c5b9-b2d5-4fc7-a978-6cdb20a649fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:13.407088 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4078c5b9-b2d5-4fc7-a978-6cdb20a649fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.407885 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4078c5b9-b2d5-4fc7-a978-6cdb20a649fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:13.408325 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4078c5b9-b2d5-4fc7-a978-6cdb20a649fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.550398 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4078c5b9-b2d5-4fc7-a978-6cdb20a649fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:13.559560 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4078c5b9-b2d5-4fc7-a978-6cdb20a649fc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.167556 Jul 24 01:14:13.560120 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 183/356] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:13 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:13.809898 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c8edcefd-2143-4da8-ad3f-c3b6dd934022 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:13.810410 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c8edcefd-2143-4da8-ad3f-c3b6dd934022 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:13.819052 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c8edcefd-2143-4da8-ad3f-c3b6dd934022 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:13.819611 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c8edcefd-2143-4da8-ad3f-c3b6dd934022 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.820456 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c8edcefd-2143-4da8-ad3f-c3b6dd934022 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:13.820959 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c8edcefd-2143-4da8-ad3f-c3b6dd934022 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.954262 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c8edcefd-2143-4da8-ad3f-c3b6dd934022 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:13.962361 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c8edcefd-2143-4da8-ad3f-c3b6dd934022 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1508 microversion: 2.1 time: 0.156598 Jul 24 01:14:13.963169 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 174/357] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:13 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:14.049422 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-cd03e424-5384-4ade-bc34-721a57a0db48 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:14.050071 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-cd03e424-5384-4ade-bc34-721a57a0db48 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:14.057381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cd03e424-5384-4ade-bc34-721a57a0db48 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:14.057833 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cd03e424-5384-4ade-bc34-721a57a0db48 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:14.058603 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cd03e424-5384-4ade-bc34-721a57a0db48 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:14.059036 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cd03e424-5384-4ade-bc34-721a57a0db48 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:14.206496 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-cd03e424-5384-4ade-bc34-721a57a0db48 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:14.214392 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-cd03e424-5384-4ade-bc34-721a57a0db48 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1502 microversion: 2.1 time: 0.169187 Jul 24 01:14:14.214953 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 184/358] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:14 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:14.580668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3bcd1ab7-ae71-400c-bc8d-02230e588b2f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:14.581646 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3bcd1ab7-ae71-400c-bc8d-02230e588b2f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:14.590085 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3bcd1ab7-ae71-400c-bc8d-02230e588b2f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:14.590537 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3bcd1ab7-ae71-400c-bc8d-02230e588b2f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:14.591322 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3bcd1ab7-ae71-400c-bc8d-02230e588b2f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:14.591765 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3bcd1ab7-ae71-400c-bc8d-02230e588b2f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:14.747236 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3bcd1ab7-ae71-400c-bc8d-02230e588b2f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:14.756867 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3bcd1ab7-ae71-400c-bc8d-02230e588b2f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1318 microversion: 2.1 time: 0.181717 Jul 24 01:14:14.757619 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 175/359] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:14 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:14.981215 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-be159fcd-187f-4c01-b367-afab2950dabe tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:14.981815 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-be159fcd-187f-4c01-b367-afab2950dabe tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:14.989736 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be159fcd-187f-4c01-b367-afab2950dabe tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:14.990413 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be159fcd-187f-4c01-b367-afab2950dabe tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:14.991970 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be159fcd-187f-4c01-b367-afab2950dabe tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:14.992416 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be159fcd-187f-4c01-b367-afab2950dabe tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:15.197171 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-be159fcd-187f-4c01-b367-afab2950dabe tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:15.205345 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-be159fcd-187f-4c01-b367-afab2950dabe tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1508 microversion: 2.1 time: 0.228227 Jul 24 01:14:15.206039 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 185/360] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:14 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:15.235262 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4800c140-4627-47e7-a269-1e87add1f191 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:15.237256 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4800c140-4627-47e7-a269-1e87add1f191 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:15.248572 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4800c140-4627-47e7-a269-1e87add1f191 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:15.249679 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4800c140-4627-47e7-a269-1e87add1f191 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:15.250600 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4800c140-4627-47e7-a269-1e87add1f191 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:15.251382 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4800c140-4627-47e7-a269-1e87add1f191 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:15.463187 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4800c140-4627-47e7-a269-1e87add1f191 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:15.471057 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4800c140-4627-47e7-a269-1e87add1f191 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 200 len: 1502 microversion: 2.1 time: 0.244066 Jul 24 01:14:15.471842 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 176/361] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:15 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:15.569598 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-4c1c14c5-b3ac-4eb1-9851-4b2cf3939b9e req-e6ffa2d3-0779-4077-bafc-f08ab922a427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6ddd6a-fc62-4071-8343-fd371ac2b857", "name": "network-vif-deleted", "tag": "7648f11b-85dc-4114-aa30-70e02c45ae4e"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:15.577765 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-4c1c14c5-b3ac-4eb1-9851-4b2cf3939b9e req-e6ffa2d3-0779-4077-bafc-f08ab922a427 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:15.578200 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-4c1c14c5-b3ac-4eb1-9851-4b2cf3939b9e req-e6ffa2d3-0779-4077-bafc-f08ab922a427 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:15.588975 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-4c1c14c5-b3ac-4eb1-9851-4b2cf3939b9e req-e6ffa2d3-0779-4077-bafc-f08ab922a427 service nova] Creating event network-vif-deleted:7648f11b-85dc-4114-aa30-70e02c45ae4e for instance 5e6ddd6a-fc62-4071-8343-fd371ac2b857 on hv-cinder-maste Jul 24 01:14:15.593731 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-4c1c14c5-b3ac-4eb1-9851-4b2cf3939b9e req-e6ffa2d3-0779-4077-bafc-f08ab922a427 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027828 Jul 24 01:14:15.594286 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 186/362] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:15.774345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-de1baf1d-3cd0-41b7-bdd9-7857b562c42f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:15.774955 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-de1baf1d-3cd0-41b7-bdd9-7857b562c42f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:15.777013 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:15.782449 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-de1baf1d-3cd0-41b7-bdd9-7857b562c42f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:15.782893 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-de1baf1d-3cd0-41b7-bdd9-7857b562c42f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:15.783686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-de1baf1d-3cd0-41b7-bdd9-7857b562c42f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:15.784105 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-de1baf1d-3cd0-41b7-bdd9-7857b562c42f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:16.030480 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-de1baf1d-3cd0-41b7-bdd9-7857b562c42f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:16.034678 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:16.041375 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-de1baf1d-3cd0-41b7-bdd9-7857b562c42f tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1507 microversion: 2.1 time: 0.270653 Jul 24 01:14:16.042330 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 177/363] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:15 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:16.223025 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-761f4ad9-e29c-4472-bc7a-381792413a72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:16.224109 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-761f4ad9-e29c-4472-bc7a-381792413a72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:16.230921 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-761f4ad9-e29c-4472-bc7a-381792413a72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:16.231166 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-761f4ad9-e29c-4472-bc7a-381792413a72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:16.231960 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-761f4ad9-e29c-4472-bc7a-381792413a72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:16.232615 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-761f4ad9-e29c-4472-bc7a-381792413a72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:16.492702 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:16.493823 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5e6ddd6a-fc62-4071-8343-fd371ac2b857] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:16.502624 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:16.503501 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:16.504463 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:16.505053 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:16.523602 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] HTTP exception thrown: Instance 5e6ddd6a-fc62-4071-8343-fd371ac2b857 could not be found. Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Request method failure captured: Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 HTTP/1.1 Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JzKDKUUQ8o8hKOCpDFpIjJbujM3HA4jH-zkl422P-msO8PZoQ4qQqU5rLQyWrexaZABX1x76oeIUBFAR1NNnHo4H6frW38sHBQoM37yAmOKlR_jvXl58d6G6UbkyVQMxZ1vRY8OGUiahlVTTF8N86NV3Acr7If40PR9BWPM8Vg62_I Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: eeb22bb3227a42cd8cce008519e7f870 Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesActionsTest-675412498 Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:14:16.525810 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eeb22bb3227a42cd8cce008519e7f870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eeb22bb3227a42cd8cce008519e7f870", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eeb22bb3227a42cd8cce008519e7f870"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eeb22bb3227a42cd8cce008519e7f870"}]}] Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesActionsTest-675412498 Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: eeb22bb3227a42cd8cce008519e7f870 Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesActionsTest-675412498 Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesActionsTest-675412498-project Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: b7e654fe35564c52878bc60880954dde Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesActionsTest-675412498-project Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 5e6ddd6a-fc62-4071-8343-fd371ac2b857 could not be found. Jul 24 01:14:16.527083 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '5e6ddd6a-fc62-4071-8343-fd371ac2b857'} Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6ddd6a-fc62-4071-8343-fd371ac2b857 could not be found. Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:16.528075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6ddd6a-fc62-4071-8343-fd371ac2b857 could not be found. Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6ddd6a-fc62-4071-8343-fd371ac2b857 could not be found. Jul 24 01:14:16.529252 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:14:16.532729 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Returning 404 to user: Instance 5e6ddd6a-fc62-4071-8343-fd371ac2b857 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:16.533758 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e34e4469-f979-46ab-ab58-aedada533b11 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857" status: 404 len: 111 microversion: 2.1 time: 0.047157 Jul 24 01:14:16.535518 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 178/364] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:16 2022] GET /compute/v2.1/servers/5e6ddd6a-fc62-4071-8343-fd371ac2b857 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:16.611702 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-761f4ad9-e29c-4472-bc7a-381792413a72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:16.626730 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-761f4ad9-e29c-4472-bc7a-381792413a72 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1508 microversion: 2.1 time: 0.405767 Jul 24 01:14:16.628755 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 187/365] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:16 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1508 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:16.670356 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-418636279", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "networks": [{"uuid": "d4d39d43-febf-43f7-9d96-40b71cf4fee5"}]}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:16.752298 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] validate_networks() for [('d4d39d43-febf-43f7-9d96-40b71cf4fee5', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:14:17.265799 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:14:17.266223 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:14:17.266686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:14:17.267109 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:14:17.267745 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:14:17.279165 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:17.279640 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:17.280508 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:17.280938 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:17.297463 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Getting quotas for project eeb22bb3227a42cd8cce008519e7f870. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:14:17.302182 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Getting quotas for user b7e654fe35564c52878bc60880954dde and project eeb22bb3227a42cd8cce008519e7f870. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:14:17.313351 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:14:17.315573 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:14:17.362925 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b0b07efc-7def-4d51-9390-a7b31af1bbca tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700102 Jul 24 01:14:17.363737 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 179/366] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:14:17.373381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-210811c4-220d-4b0a-9a50-08a42cfa1fde tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:17.373999 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-210811c4-220d-4b0a-9a50-08a42cfa1fde tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:17.446507 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-210811c4-220d-4b0a-9a50-08a42cfa1fde tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:17.456786 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-210811c4-220d-4b0a-9a50-08a42cfa1fde tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1213 microversion: 2.1 time: 0.087052 Jul 24 01:14:17.464982 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 188/367] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:17 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:17.646148 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-cd034b73-cb19-4342-9861-3be7ef4bc8fb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:17.646770 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-cd034b73-cb19-4342-9861-3be7ef4bc8fb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:17.654661 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cd034b73-cb19-4342-9861-3be7ef4bc8fb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:17.655170 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cd034b73-cb19-4342-9861-3be7ef4bc8fb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:17.656215 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cd034b73-cb19-4342-9861-3be7ef4bc8fb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:17.656642 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cd034b73-cb19-4342-9861-3be7ef4bc8fb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:17.822289 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cd034b73-cb19-4342-9861-3be7ef4bc8fb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:17.830158 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-cd034b73-cb19-4342-9861-3be7ef4bc8fb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1508 microversion: 2.1 time: 0.189056 Jul 24 01:14:17.830723 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 180/368] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:17 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:18.474949 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-fdc82d64-1710-439b-9b28-e1642d184532 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:18.475553 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-fdc82d64-1710-439b-9b28-e1642d184532 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:18.484497 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fdc82d64-1710-439b-9b28-e1642d184532 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:18.484904 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fdc82d64-1710-439b-9b28-e1642d184532 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:18.485761 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fdc82d64-1710-439b-9b28-e1642d184532 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:18.486308 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fdc82d64-1710-439b-9b28-e1642d184532 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:18.549814 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-fdc82d64-1710-439b-9b28-e1642d184532 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:18.557855 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-fdc82d64-1710-439b-9b28-e1642d184532 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1217 microversion: 2.1 time: 0.087304 Jul 24 01:14:18.558430 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 189/369] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:18 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:18.848967 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f5a35a2b-78f0-4ba2-9ae6-8dc07edaa8d1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:18.863686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f5a35a2b-78f0-4ba2-9ae6-8dc07edaa8d1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:18.863686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f5a35a2b-78f0-4ba2-9ae6-8dc07edaa8d1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:18.863686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f5a35a2b-78f0-4ba2-9ae6-8dc07edaa8d1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:18.863686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f5a35a2b-78f0-4ba2-9ae6-8dc07edaa8d1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:18.864122 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f5a35a2b-78f0-4ba2-9ae6-8dc07edaa8d1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:18.999252 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f5a35a2b-78f0-4ba2-9ae6-8dc07edaa8d1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:19.008117 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f5a35a2b-78f0-4ba2-9ae6-8dc07edaa8d1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1508 microversion: 2.1 time: 0.163303 Jul 24 01:14:19.025168 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 181/370] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:18 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:19.575414 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-88d71b46-9c7c-4be8-b232-6b0b481e8de8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:19.576121 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-88d71b46-9c7c-4be8-b232-6b0b481e8de8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:19.582697 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-88d71b46-9c7c-4be8-b232-6b0b481e8de8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:19.583139 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-88d71b46-9c7c-4be8-b232-6b0b481e8de8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:19.583919 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-88d71b46-9c7c-4be8-b232-6b0b481e8de8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:19.584341 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-88d71b46-9c7c-4be8-b232-6b0b481e8de8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:19.647014 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-88d71b46-9c7c-4be8-b232-6b0b481e8de8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:19.654607 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-88d71b46-9c7c-4be8-b232-6b0b481e8de8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1265 microversion: 2.1 time: 0.083308 Jul 24 01:14:19.655162 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 190/371] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:19 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:20.043633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8e45be2d-8639-4262-9f53-f6e611789077 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:20.044396 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8e45be2d-8639-4262-9f53-f6e611789077 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:20.064826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8e45be2d-8639-4262-9f53-f6e611789077 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.065374 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8e45be2d-8639-4262-9f53-f6e611789077 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:20.066226 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8e45be2d-8639-4262-9f53-f6e611789077 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.066817 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8e45be2d-8639-4262-9f53-f6e611789077 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:20.199679 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8e45be2d-8639-4262-9f53-f6e611789077 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:20.207723 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8e45be2d-8639-4262-9f53-f6e611789077 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1514 microversion: 2.1 time: 0.173776 Jul 24 01:14:20.208318 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 182/372] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:20 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:20.672245 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-acb3f935-d3f1-4fff-b941-820ed3f6b540 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:20.672790 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-acb3f935-d3f1-4fff-b941-820ed3f6b540 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:20.679668 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acb3f935-d3f1-4fff-b941-820ed3f6b540 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.680809 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acb3f935-d3f1-4fff-b941-820ed3f6b540 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:20.681637 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acb3f935-d3f1-4fff-b941-820ed3f6b540 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.682109 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acb3f935-d3f1-4fff-b941-820ed3f6b540 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:20.759306 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-acb3f935-d3f1-4fff-b941-820ed3f6b540 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:20.768946 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-acb3f935-d3f1-4fff-b941-820ed3f6b540 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1283 microversion: 2.1 time: 0.100780 Jul 24 01:14:20.769497 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 191/373] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:20 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1283 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:21.573523 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f44df46f-f8c3-4920-be69-961608a3f905 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'create', calling method: .version_select at 0x7fdf3c59af70>, body: {"keypair": {"name": "tempest-keypair-364310927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq7g3BDtn8t0I4f5XWHP+ZMKfVjQYoS9xSw2308HeSA+77jhD8f7cGW1acfEvU5Fb/A2gglVR6cDkpviUhO2bpNH/FXnZPEiDtAwy27wyiHnxmtUiDy5bTuw8hsRUHDXg=="}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:21.591981 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-f44df46f-f8c3-4920-be69-961608a3f905 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Getting quotas for project 55d33269082642989cbc18c052f07b94. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:14:21.596400 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-f44df46f-f8c3-4920-be69-961608a3f905 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Getting quotas for user 1b8154ce6b6b40b4959bf354ccb5c59d and project 55d33269082642989cbc18c052f07b94. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:14:21.620763 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f44df46f-f8c3-4920-be69-961608a3f905 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051862 Jul 24 01:14:21.621439 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 183/374] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Jul 24 01:14:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:21.786462 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b5703641-d39a-46d7-8565-98e31ff22c98 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:21.787015 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b5703641-d39a-46d7-8565-98e31ff22c98 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:21.794512 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b5703641-d39a-46d7-8565-98e31ff22c98 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:21.795275 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b5703641-d39a-46d7-8565-98e31ff22c98 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:21.796101 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b5703641-d39a-46d7-8565-98e31ff22c98 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:21.796537 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b5703641-d39a-46d7-8565-98e31ff22c98 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:22.049330 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b5703641-d39a-46d7-8565-98e31ff22c98 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:22.057967 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b5703641-d39a-46d7-8565-98e31ff22c98 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.275563 Jul 24 01:14:22.058570 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 192/375] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:21 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:22.453112 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-0a163ded-84bb-40dd-8c54-a2a82d3c4226 req-b6a7534c-8807-4d5c-9ba2-f7eebdafc488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f92b499-7518-43eb-8031-a3dd9da5b9cb", "tag": "09f6667f-1c33-4630-b272-6a88a5481894"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:22.469266 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0a163ded-84bb-40dd-8c54-a2a82d3c4226 req-b6a7534c-8807-4d5c-9ba2-f7eebdafc488 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:22.469851 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0a163ded-84bb-40dd-8c54-a2a82d3c4226 req-b6a7534c-8807-4d5c-9ba2-f7eebdafc488 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:22.485067 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-0a163ded-84bb-40dd-8c54-a2a82d3c4226 req-b6a7534c-8807-4d5c-9ba2-f7eebdafc488 service nova] Creating event network-changed:09f6667f-1c33-4630-b272-6a88a5481894 for instance 5f92b499-7518-43eb-8031-a3dd9da5b9cb on hv-cinder-maste Jul 24 01:14:22.489789 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-0a163ded-84bb-40dd-8c54-a2a82d3c4226 req-b6a7534c-8807-4d5c-9ba2-f7eebdafc488 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040416 Jul 24 01:14:22.490423 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 184/376] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:23.075162 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-babd7375-e9ee-4051-acbd-38f029851be8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:23.076448 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-babd7375-e9ee-4051-acbd-38f029851be8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:23.083147 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-babd7375-e9ee-4051-acbd-38f029851be8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:23.083626 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-babd7375-e9ee-4051-acbd-38f029851be8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:23.084400 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-babd7375-e9ee-4051-acbd-38f029851be8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:23.084834 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-babd7375-e9ee-4051-acbd-38f029851be8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:23.100426 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:23.310377 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-babd7375-e9ee-4051-acbd-38f029851be8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:23.321321 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-babd7375-e9ee-4051-acbd-38f029851be8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.250088 Jul 24 01:14:23.329576 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 193/377] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:23 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:23.350726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2132165625", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c20a7dfc-f709-4537-b8c6-5da500bdb8c8"}], "security_groups": [{"name": "tempest-securitygroup--1624079952"}], "key_name": "tempest-keypair-364310927", "user_data": "}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:24.339047 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-53516691-d7a0-4908-ab36-b3579aeefe6d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:24.339619 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-53516691-d7a0-4908-ab36-b3579aeefe6d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:24.346098 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53516691-d7a0-4908-ab36-b3579aeefe6d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:24.346543 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53516691-d7a0-4908-ab36-b3579aeefe6d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:24.347345 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53516691-d7a0-4908-ab36-b3579aeefe6d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:24.347778 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53516691-d7a0-4908-ab36-b3579aeefe6d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:24.481500 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-53516691-d7a0-4908-ab36-b3579aeefe6d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:24.489480 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-53516691-d7a0-4908-ab36-b3579aeefe6d tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.155222 Jul 24 01:14:24.490041 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 194/378] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:24 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:25.507030 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-83e3d1d7-ce90-4f92-a9f2-7f198c5267ff tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:25.507744 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-83e3d1d7-ce90-4f92-a9f2-7f198c5267ff tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:25.514869 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-83e3d1d7-ce90-4f92-a9f2-7f198c5267ff tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:25.515417 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-83e3d1d7-ce90-4f92-a9f2-7f198c5267ff tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:25.516175 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-83e3d1d7-ce90-4f92-a9f2-7f198c5267ff tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:25.516611 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-83e3d1d7-ce90-4f92-a9f2-7f198c5267ff tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:25.649378 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-83e3d1d7-ce90-4f92-a9f2-7f198c5267ff tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:25.657235 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-83e3d1d7-ce90-4f92-a9f2-7f198c5267ff tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.154214 Jul 24 01:14:25.657767 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 195/379] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:25 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:26.674286 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c606e2d3-f664-4173-931b-8893fcc40f54 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:26.674967 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c606e2d3-f664-4173-931b-8893fcc40f54 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:26.682489 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c606e2d3-f664-4173-931b-8893fcc40f54 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:26.683047 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c606e2d3-f664-4173-931b-8893fcc40f54 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:26.683840 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c606e2d3-f664-4173-931b-8893fcc40f54 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:26.684268 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c606e2d3-f664-4173-931b-8893fcc40f54 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:26.821698 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c606e2d3-f664-4173-931b-8893fcc40f54 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:26.829692 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c606e2d3-f664-4173-931b-8893fcc40f54 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.159268 Jul 24 01:14:26.830260 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 196/380] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:26 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:27.288452 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:27.846467 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8e05b0ea-4aae-4c38-8c8f-43d664a6ccb2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:27.847088 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8e05b0ea-4aae-4c38-8c8f-43d664a6ccb2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:27.848998 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:27.850112 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=92 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:27.856230 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e05b0ea-4aae-4c38-8c8f-43d664a6ccb2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:27.856699 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e05b0ea-4aae-4c38-8c8f-43d664a6ccb2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:27.857468 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e05b0ea-4aae-4c38-8c8f-43d664a6ccb2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:27.857904 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e05b0ea-4aae-4c38-8c8f-43d664a6ccb2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:27.993649 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8e05b0ea-4aae-4c38-8c8f-43d664a6ccb2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:28.001612 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8e05b0ea-4aae-4c38-8c8f-43d664a6ccb2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.159101 Jul 24 01:14:28.002148 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 197/381] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:27 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:29.019516 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0821658a-fc3d-4fe9-8b77-736336643d3b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:29.020269 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0821658a-fc3d-4fe9-8b77-736336643d3b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:29.027021 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0821658a-fc3d-4fe9-8b77-736336643d3b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:29.027537 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0821658a-fc3d-4fe9-8b77-736336643d3b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:29.028295 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0821658a-fc3d-4fe9-8b77-736336643d3b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:29.028731 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0821658a-fc3d-4fe9-8b77-736336643d3b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:29.167960 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0821658a-fc3d-4fe9-8b77-736336643d3b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:29.176058 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0821658a-fc3d-4fe9-8b77-736336643d3b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.160519 Jul 24 01:14:29.176974 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 198/382] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:29 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:30.193625 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c5c3eb17-93de-40ef-90e7-eb3209ea944f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:30.194338 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c5c3eb17-93de-40ef-90e7-eb3209ea944f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:30.201331 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c5c3eb17-93de-40ef-90e7-eb3209ea944f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:30.201782 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c5c3eb17-93de-40ef-90e7-eb3209ea944f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:30.202553 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c5c3eb17-93de-40ef-90e7-eb3209ea944f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:30.202991 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c5c3eb17-93de-40ef-90e7-eb3209ea944f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:30.342811 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c5c3eb17-93de-40ef-90e7-eb3209ea944f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:30.350703 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c5c3eb17-93de-40ef-90e7-eb3209ea944f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.161047 Jul 24 01:14:30.351286 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 199/383] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:30 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:31.369428 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5157ce99-78ec-47d0-ac75-3c7916585344 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:31.370270 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-5157ce99-78ec-47d0-ac75-3c7916585344 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:31.378211 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5157ce99-78ec-47d0-ac75-3c7916585344 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:31.378657 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5157ce99-78ec-47d0-ac75-3c7916585344 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:31.379456 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5157ce99-78ec-47d0-ac75-3c7916585344 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:31.379893 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5157ce99-78ec-47d0-ac75-3c7916585344 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:31.513581 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-5157ce99-78ec-47d0-ac75-3c7916585344 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:31.521094 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5157ce99-78ec-47d0-ac75-3c7916585344 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.156691 Jul 24 01:14:31.521655 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 200/384] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:31 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:31.603334 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=10 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:32.478545 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=24 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:32.537933 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-55d2c6a4-41fd-48b8-9700-fc5b595e5cd0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:32.538540 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-55d2c6a4-41fd-48b8-9700-fc5b595e5cd0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:32.545642 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-55d2c6a4-41fd-48b8-9700-fc5b595e5cd0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:32.546096 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-55d2c6a4-41fd-48b8-9700-fc5b595e5cd0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:32.546908 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-55d2c6a4-41fd-48b8-9700-fc5b595e5cd0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:32.547264 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-55d2c6a4-41fd-48b8-9700-fc5b595e5cd0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:32.682760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-55d2c6a4-41fd-48b8-9700-fc5b595e5cd0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:32.691286 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-55d2c6a4-41fd-48b8-9700-fc5b595e5cd0 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.156940 Jul 24 01:14:32.691637 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 201/385] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:32 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:33.359605 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:33.708598 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-fd75aca8-0c4c-4dbd-8c09-38416b6e1cd8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:33.709229 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-fd75aca8-0c4c-4dbd-8c09-38416b6e1cd8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:33.716129 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fd75aca8-0c4c-4dbd-8c09-38416b6e1cd8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:33.716575 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fd75aca8-0c4c-4dbd-8c09-38416b6e1cd8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:33.717327 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fd75aca8-0c4c-4dbd-8c09-38416b6e1cd8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:33.717731 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fd75aca8-0c4c-4dbd-8c09-38416b6e1cd8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:33.885328 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-fd75aca8-0c4c-4dbd-8c09-38416b6e1cd8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:33.887399 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] validate_networks() for [('c20a7dfc-f709-4537-b8c6-5da500bdb8c8', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:14:33.892869 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-fd75aca8-0c4c-4dbd-8c09-38416b6e1cd8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.188163 Jul 24 01:14:33.893443 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 202/386] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:33 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:34.270176 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:14:34.270721 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:14:34.271184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:14:34.271628 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:14:34.272029 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:14:34.281857 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.282295 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.283080 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.283535 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.300823 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Getting quotas for project 55d33269082642989cbc18c052f07b94. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:14:34.306030 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Getting quotas for user 1b8154ce6b6b40b4959bf354ccb5c59d and project 55d33269082642989cbc18c052f07b94. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:14:34.319777 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:14:34.322353 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:14:34.374492 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-92969a49-351a-4f9e-8d66-bc8946646ddb tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 11.029014 Jul 24 01:14:34.375443 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 185/387] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:14:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 11031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:14:34.385991 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-23a4347b-ee01-433e-9763-e6faa19a6076 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:34.386916 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-23a4347b-ee01-433e-9763-e6faa19a6076 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:34.443523 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-23a4347b-ee01-433e-9763-e6faa19a6076 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:34.450191 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-23a4347b-ee01-433e-9763-e6faa19a6076 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1245 microversion: 2.1 time: 0.068463 Jul 24 01:14:34.450733 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 203/388] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:34 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:34.909501 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-705284c7-a718-4be8-8536-8e8e60f4d6fc tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:34.910107 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-705284c7-a718-4be8-8536-8e8e60f4d6fc tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:34.916714 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-705284c7-a718-4be8-8536-8e8e60f4d6fc tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.917155 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-705284c7-a718-4be8-8536-8e8e60f4d6fc tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.917904 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-705284c7-a718-4be8-8536-8e8e60f4d6fc tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.918332 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-705284c7-a718-4be8-8536-8e8e60f4d6fc tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:35.054718 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-705284c7-a718-4be8-8536-8e8e60f4d6fc tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:35.062357 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-705284c7-a718-4be8-8536-8e8e60f4d6fc tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.157274 Jul 24 01:14:35.062926 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 186/389] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:34 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:35.467437 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0cd3ed52-6f8e-4125-80e2-a221b795b272 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:35.468066 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0cd3ed52-6f8e-4125-80e2-a221b795b272 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:35.475328 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0cd3ed52-6f8e-4125-80e2-a221b795b272 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:35.475783 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0cd3ed52-6f8e-4125-80e2-a221b795b272 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:35.476542 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0cd3ed52-6f8e-4125-80e2-a221b795b272 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:35.476978 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0cd3ed52-6f8e-4125-80e2-a221b795b272 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:35.542552 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0cd3ed52-6f8e-4125-80e2-a221b795b272 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:35.550413 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0cd3ed52-6f8e-4125-80e2-a221b795b272 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1297 microversion: 2.1 time: 0.086879 Jul 24 01:14:35.551023 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 204/390] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:35 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:36.083435 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-501ec264-5893-4d62-aa49-d3f8216d3c60 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:36.084268 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-501ec264-5893-4d62-aa49-d3f8216d3c60 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:36.091947 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-501ec264-5893-4d62-aa49-d3f8216d3c60 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.092398 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-501ec264-5893-4d62-aa49-d3f8216d3c60 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.093168 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-501ec264-5893-4d62-aa49-d3f8216d3c60 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.093604 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-501ec264-5893-4d62-aa49-d3f8216d3c60 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.239418 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-501ec264-5893-4d62-aa49-d3f8216d3c60 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:36.247609 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-501ec264-5893-4d62-aa49-d3f8216d3c60 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.170766 Jul 24 01:14:36.248177 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 187/391] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:36 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:36.568091 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5f0cfcfe-d95c-4084-85f5-d1a6d7025bdf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:36.568716 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-5f0cfcfe-d95c-4084-85f5-d1a6d7025bdf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:36.575626 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5f0cfcfe-d95c-4084-85f5-d1a6d7025bdf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.576087 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5f0cfcfe-d95c-4084-85f5-d1a6d7025bdf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.576876 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5f0cfcfe-d95c-4084-85f5-d1a6d7025bdf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.577286 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5f0cfcfe-d95c-4084-85f5-d1a6d7025bdf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.642798 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-5f0cfcfe-d95c-4084-85f5-d1a6d7025bdf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:36.650258 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5f0cfcfe-d95c-4084-85f5-d1a6d7025bdf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1297 microversion: 2.1 time: 0.085979 Jul 24 01:14:36.650808 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 205/392] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:36 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:37.268456 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-af93a7f0-88c3-4bf9-b468-77f73a7ddb36 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:37.269530 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-af93a7f0-88c3-4bf9-b468-77f73a7ddb36 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:37.280695 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-af93a7f0-88c3-4bf9-b468-77f73a7ddb36 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:37.281444 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-af93a7f0-88c3-4bf9-b468-77f73a7ddb36 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:37.282698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-af93a7f0-88c3-4bf9-b468-77f73a7ddb36 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:37.283463 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-af93a7f0-88c3-4bf9-b468-77f73a7ddb36 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:37.425852 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-af93a7f0-88c3-4bf9-b468-77f73a7ddb36 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:37.434281 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-af93a7f0-88c3-4bf9-b468-77f73a7ddb36 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.172314 Jul 24 01:14:37.434864 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 188/393] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:37 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:37.667589 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2d058c8d-bb78-4541-83ae-a1937ec159f9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:37.668230 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-2d058c8d-bb78-4541-83ae-a1937ec159f9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:37.675120 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2d058c8d-bb78-4541-83ae-a1937ec159f9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:37.675596 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2d058c8d-bb78-4541-83ae-a1937ec159f9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:37.676708 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2d058c8d-bb78-4541-83ae-a1937ec159f9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:37.677139 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2d058c8d-bb78-4541-83ae-a1937ec159f9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:37.748804 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2d058c8d-bb78-4541-83ae-a1937ec159f9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:37.757332 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2d058c8d-bb78-4541-83ae-a1937ec159f9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1297 microversion: 2.1 time: 0.093134 Jul 24 01:14:37.757661 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 206/394] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:37 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:38.455197 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2a8c00ef-6332-4bd8-bcfe-54915662bc27 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:38.456211 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2a8c00ef-6332-4bd8-bcfe-54915662bc27 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:38.465135 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2a8c00ef-6332-4bd8-bcfe-54915662bc27 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.465577 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2a8c00ef-6332-4bd8-bcfe-54915662bc27 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.466325 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2a8c00ef-6332-4bd8-bcfe-54915662bc27 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.466749 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2a8c00ef-6332-4bd8-bcfe-54915662bc27 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.526311 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-966c87ee-05f8-4443-b52a-7cf1ce641293 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:38.526808 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-966c87ee-05f8-4443-b52a-7cf1ce641293 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:38.532897 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-966c87ee-05f8-4443-b52a-7cf1ce641293 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.533349 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-966c87ee-05f8-4443-b52a-7cf1ce641293 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.534111 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-966c87ee-05f8-4443-b52a-7cf1ce641293 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.534548 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-966c87ee-05f8-4443-b52a-7cf1ce641293 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.559325 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-966c87ee-05f8-4443-b52a-7cf1ce641293 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/ips" status: 200 len: 149 microversion: 2.1 time: 0.036914 Jul 24 01:14:38.559977 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 207/395] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:14:38 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:38.600442 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2a8c00ef-6332-4bd8-bcfe-54915662bc27 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:38.608664 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2a8c00ef-6332-4bd8-bcfe-54915662bc27 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.159845 Jul 24 01:14:38.609233 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 189/396] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:38 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:38.774059 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-96ee3f92-50e4-464d-933f-21fb9c5a474f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:38.774871 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-96ee3f92-50e4-464d-933f-21fb9c5a474f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:38.781811 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96ee3f92-50e4-464d-933f-21fb9c5a474f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.782336 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96ee3f92-50e4-464d-933f-21fb9c5a474f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.783189 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96ee3f92-50e4-464d-933f-21fb9c5a474f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.783647 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96ee3f92-50e4-464d-933f-21fb9c5a474f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.883064 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-96ee3f92-50e4-464d-933f-21fb9c5a474f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:38.896941 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-96ee3f92-50e4-464d-933f-21fb9c5a474f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1297 microversion: 2.1 time: 0.120810 Jul 24 01:14:38.896941 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 208/397] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:38 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:39.625838 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-cb1e95d5-81d7-4cb2-8868-3bcaaa4dbd3c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:39.626655 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-cb1e95d5-81d7-4cb2-8868-3bcaaa4dbd3c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:39.634186 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb1e95d5-81d7-4cb2-8868-3bcaaa4dbd3c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:39.634634 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb1e95d5-81d7-4cb2-8868-3bcaaa4dbd3c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:39.635439 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb1e95d5-81d7-4cb2-8868-3bcaaa4dbd3c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:39.635848 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb1e95d5-81d7-4cb2-8868-3bcaaa4dbd3c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:39.778653 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cb1e95d5-81d7-4cb2-8868-3bcaaa4dbd3c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:39.790121 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-cb1e95d5-81d7-4cb2-8868-3bcaaa4dbd3c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.168190 Jul 24 01:14:39.790874 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 190/398] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:39 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:39.907962 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d21876c8-34ea-4900-9067-579fba9f81c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:39.909142 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d21876c8-34ea-4900-9067-579fba9f81c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:39.916047 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d21876c8-34ea-4900-9067-579fba9f81c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:39.916795 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d21876c8-34ea-4900-9067-579fba9f81c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:39.917931 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d21876c8-34ea-4900-9067-579fba9f81c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:39.918570 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d21876c8-34ea-4900-9067-579fba9f81c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:39.992541 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d21876c8-34ea-4900-9067-579fba9f81c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:40.000238 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d21876c8-34ea-4900-9067-579fba9f81c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1297 microversion: 2.1 time: 0.097158 Jul 24 01:14:40.000800 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 209/399] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:39 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:40.789207 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c569bac7-ec04-46cc-b983-d203be586211 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:40.789829 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c569bac7-ec04-46cc-b983-d203be586211 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:40.796551 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c569bac7-ec04-46cc-b983-d203be586211 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:40.796987 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c569bac7-ec04-46cc-b983-d203be586211 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:40.797959 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c569bac7-ec04-46cc-b983-d203be586211 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:40.798393 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c569bac7-ec04-46cc-b983-d203be586211 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:40.808390 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4e099a71-4a67-4a4d-8b7b-0d38f782be0c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:40.809069 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4e099a71-4a67-4a4d-8b7b-0d38f782be0c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:40.820706 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4e099a71-4a67-4a4d-8b7b-0d38f782be0c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:40.821375 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4e099a71-4a67-4a4d-8b7b-0d38f782be0c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:40.822156 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4e099a71-4a67-4a4d-8b7b-0d38f782be0c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:40.822967 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4e099a71-4a67-4a4d-8b7b-0d38f782be0c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:40.825203 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c569bac7-ec04-46cc-b983-d203be586211 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/ips" status: 200 len: 146 microversion: 2.1 time: 0.039894 Jul 24 01:14:40.830607 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 191/400] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:14:40 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:41.017306 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-005695b7-51ed-4eb3-9b48-adaf37864939 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:41.017920 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-005695b7-51ed-4eb3-9b48-adaf37864939 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:41.024696 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-005695b7-51ed-4eb3-9b48-adaf37864939 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:41.025176 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-005695b7-51ed-4eb3-9b48-adaf37864939 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:41.025983 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-005695b7-51ed-4eb3-9b48-adaf37864939 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:41.026416 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-005695b7-51ed-4eb3-9b48-adaf37864939 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:41.216573 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-005695b7-51ed-4eb3-9b48-adaf37864939 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:41.224136 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-005695b7-51ed-4eb3-9b48-adaf37864939 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1303 microversion: 2.1 time: 0.210690 Jul 24 01:14:41.224711 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 192/401] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:41 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:41.229483 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8b781f89-8dfe-4a0a-9203-c5580ff4ae64 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5868751f-c6d5-4175-a7e9-e5457b67fc9b"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:41.230596 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8b781f89-8dfe-4a0a-9203-c5580ff4ae64 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:41.236753 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8b781f89-8dfe-4a0a-9203-c5580ff4ae64 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:41.237205 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8b781f89-8dfe-4a0a-9203-c5580ff4ae64 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:41.237978 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8b781f89-8dfe-4a0a-9203-c5580ff4ae64 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:41.238410 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8b781f89-8dfe-4a0a-9203-c5580ff4ae64 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:41.341312 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4e099a71-4a67-4a4d-8b7b-0d38f782be0c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:41.349401 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4e099a71-4a67-4a4d-8b7b-0d38f782be0c tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.544899 Jul 24 01:14:41.350096 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 210/402] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:40 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:41.603966 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8b781f89-8dfe-4a0a-9203-c5580ff4ae64 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378022 Jul 24 01:14:41.604603 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 193/403] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:14:41 2022] POST /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:42.242447 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-43359289-57be-48e1-8ebc-2c1d1858716c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:42.243449 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-43359289-57be-48e1-8ebc-2c1d1858716c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:42.249951 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-43359289-57be-48e1-8ebc-2c1d1858716c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:42.250951 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-43359289-57be-48e1-8ebc-2c1d1858716c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:42.251956 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-43359289-57be-48e1-8ebc-2c1d1858716c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:42.252580 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-43359289-57be-48e1-8ebc-2c1d1858716c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:42.268395 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=100 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:42.367510 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9754cf9a-16bd-476b-babc-7f2c8df78116 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:42.368408 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9754cf9a-16bd-476b-babc-7f2c8df78116 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:42.379100 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9754cf9a-16bd-476b-babc-7f2c8df78116 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:42.380396 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9754cf9a-16bd-476b-babc-7f2c8df78116 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:42.380729 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9754cf9a-16bd-476b-babc-7f2c8df78116 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:42.381637 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9754cf9a-16bd-476b-babc-7f2c8df78116 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:42.510675 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-43359289-57be-48e1-8ebc-2c1d1858716c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:42.520080 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-43359289-57be-48e1-8ebc-2c1d1858716c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.282320 Jul 24 01:14:42.521456 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 211/404] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:42 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:42.594602 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9754cf9a-16bd-476b-babc-7f2c8df78116 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:42.602509 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9754cf9a-16bd-476b-babc-7f2c8df78116 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.239623 Jul 24 01:14:42.603135 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 194/405] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:42 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:42.711981 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-03dddab2-b4b9-492b-93b2-34c17c4442e3 req-31da31e6-df21-4cd8-b93b-d7471c26fefe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d614ca48-40f2-4927-a2a9-65a14f2fe0a1", "tag": "f6ef1157-8359-4903-8874-ba4b3c99bee5"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:42.728491 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-03dddab2-b4b9-492b-93b2-34c17c4442e3 req-31da31e6-df21-4cd8-b93b-d7471c26fefe service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:42.729386 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-03dddab2-b4b9-492b-93b2-34c17c4442e3 req-31da31e6-df21-4cd8-b93b-d7471c26fefe service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:42.745826 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-03dddab2-b4b9-492b-93b2-34c17c4442e3 req-31da31e6-df21-4cd8-b93b-d7471c26fefe service nova] Creating event network-changed:f6ef1157-8359-4903-8874-ba4b3c99bee5 for instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 on hv-cinder-maste Jul 24 01:14:42.751399 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-03dddab2-b4b9-492b-93b2-34c17c4442e3 req-31da31e6-df21-4cd8-b93b-d7471c26fefe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047789 Jul 24 01:14:42.752310 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 212/406] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:42.855786 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-ba018704-f4e4-4606-8bab-9a3e55645462 req-519dea96-768e-4159-96b1-b538ecb9a8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f92b499-7518-43eb-8031-a3dd9da5b9cb", "name": "network-vif-plugged", "status": "completed", "tag": "09f6667f-1c33-4630-b272-6a88a5481894"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:42.864975 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-ba018704-f4e4-4606-8bab-9a3e55645462 req-519dea96-768e-4159-96b1-b538ecb9a8ff service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:42.865627 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-ba018704-f4e4-4606-8bab-9a3e55645462 req-519dea96-768e-4159-96b1-b538ecb9a8ff service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:42.877721 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-ba018704-f4e4-4606-8bab-9a3e55645462 req-519dea96-768e-4159-96b1-b538ecb9a8ff service nova] Creating event network-vif-plugged:09f6667f-1c33-4630-b272-6a88a5481894 for instance 5f92b499-7518-43eb-8031-a3dd9da5b9cb on hv-cinder-maste Jul 24 01:14:42.882531 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-ba018704-f4e4-4606-8bab-9a3e55645462 req-519dea96-768e-4159-96b1-b538ecb9a8ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031352 Jul 24 01:14:42.883101 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 195/407] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:14:43.543007 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-09e0ec82-4336-4266-a9c0-569b8b34e8bf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:43.544223 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-09e0ec82-4336-4266-a9c0-569b8b34e8bf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:43.557127 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09e0ec82-4336-4266-a9c0-569b8b34e8bf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.557594 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09e0ec82-4336-4266-a9c0-569b8b34e8bf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.558378 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09e0ec82-4336-4266-a9c0-569b8b34e8bf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.558819 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09e0ec82-4336-4266-a9c0-569b8b34e8bf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.621147 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d3aa8d1e-a38e-43b8-b0dc-ea3f1c2fba64 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:43.621843 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d3aa8d1e-a38e-43b8-b0dc-ea3f1c2fba64 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:43.632156 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3aa8d1e-a38e-43b8-b0dc-ea3f1c2fba64 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.632615 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3aa8d1e-a38e-43b8-b0dc-ea3f1c2fba64 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.633377 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3aa8d1e-a38e-43b8-b0dc-ea3f1c2fba64 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.633810 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3aa8d1e-a38e-43b8-b0dc-ea3f1c2fba64 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.765260 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-09e0ec82-4336-4266-a9c0-569b8b34e8bf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:43.781459 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-09e0ec82-4336-4266-a9c0-569b8b34e8bf tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.239101 Jul 24 01:14:43.782208 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 213/408] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:43 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:43.868046 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d3aa8d1e-a38e-43b8-b0dc-ea3f1c2fba64 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:43.875759 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d3aa8d1e-a38e-43b8-b0dc-ea3f1c2fba64 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.259787 Jul 24 01:14:43.876542 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 196/409] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:43 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:44.801656 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c05b482f-b5bc-484c-8903-888dd88dc16c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:44.802228 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c05b482f-b5bc-484c-8903-888dd88dc16c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:44.807587 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:44.810251 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c05b482f-b5bc-484c-8903-888dd88dc16c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:44.810706 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c05b482f-b5bc-484c-8903-888dd88dc16c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:44.813067 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c05b482f-b5bc-484c-8903-888dd88dc16c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:44.813694 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c05b482f-b5bc-484c-8903-888dd88dc16c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:44.892857 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-356d2645-9cdd-4ec5-a655-c07378089ae8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:44.893740 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-356d2645-9cdd-4ec5-a655-c07378089ae8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:44.896134 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:44.897881 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=6 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:44.904857 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-356d2645-9cdd-4ec5-a655-c07378089ae8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:44.905815 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-356d2645-9cdd-4ec5-a655-c07378089ae8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:44.906943 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-356d2645-9cdd-4ec5-a655-c07378089ae8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:44.907652 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-356d2645-9cdd-4ec5-a655-c07378089ae8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:45.132979 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c05b482f-b5bc-484c-8903-888dd88dc16c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:45.144542 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c05b482f-b5bc-484c-8903-888dd88dc16c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.346941 Jul 24 01:14:45.145351 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 214/410] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:44 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:45.210518 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-356d2645-9cdd-4ec5-a655-c07378089ae8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:45.218607 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-356d2645-9cdd-4ec5-a655-c07378089ae8 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.329844 Jul 24 01:14:45.219414 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 197/411] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:44 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:46.001315 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-bb26dc70-45fb-4e69-ba32-ccaf76b1a4e4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: .version_select at 0x7fdf3c1c7430>, body: {"keypair": {"name": "tempest-keypair-1152461608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjMVza7szCI2OIymjomwnRTu6VednpQC4+kHYkArnW/1yb+E6PF2ljYfeuRcwctz9/Nkm4LmEq2RRjqEK9F28Iys4immkqJtQsDvM8vTKxl6U+4gPXp3IJtr/qbgL6/nA=="}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:46.017076 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-bb26dc70-45fb-4e69-ba32-ccaf76b1a4e4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:14:46.021386 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-bb26dc70-45fb-4e69-ba32-ccaf76b1a4e4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for user 1e7d0f401530454ba0cae0f5e9d6e0ce and project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:14:46.047412 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-bb26dc70-45fb-4e69-ba32-ccaf76b1a4e4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049967 Jul 24 01:14:46.048012 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 215/412] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Jul 24 01:14:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:46.162985 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f74b336c-34e3-4239-8c84-5b8e3bbec769 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:46.164270 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f74b336c-34e3-4239-8c84-5b8e3bbec769 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:46.171572 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f74b336c-34e3-4239-8c84-5b8e3bbec769 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.172029 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f74b336c-34e3-4239-8c84-5b8e3bbec769 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.172777 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f74b336c-34e3-4239-8c84-5b8e3bbec769 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.173405 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f74b336c-34e3-4239-8c84-5b8e3bbec769 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.243603 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d3a41f02-1216-41c4-b89f-3b207ff37a2b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:46.244223 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d3a41f02-1216-41c4-b89f-3b207ff37a2b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:46.258845 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3a41f02-1216-41c4-b89f-3b207ff37a2b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.259319 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3a41f02-1216-41c4-b89f-3b207ff37a2b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.260103 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3a41f02-1216-41c4-b89f-3b207ff37a2b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.260537 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3a41f02-1216-41c4-b89f-3b207ff37a2b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.417653 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f74b336c-34e3-4239-8c84-5b8e3bbec769 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:46.425706 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f74b336c-34e3-4239-8c84-5b8e3bbec769 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.267055 Jul 24 01:14:46.435451 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 198/413] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:46 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:46.489502 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d3a41f02-1216-41c4-b89f-3b207ff37a2b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:46.497379 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d3a41f02-1216-41c4-b89f-3b207ff37a2b tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1313 microversion: 2.1 time: 0.265670 Jul 24 01:14:46.506958 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 216/414] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:46 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:47.314099 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-44627df7-011d-458d-bc90-aedbd3121d3e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36626d01-bdc1-433c-b600-006e589bfc6b"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:47.315220 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-44627df7-011d-458d-bc90-aedbd3121d3e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:47.322063 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-44627df7-011d-458d-bc90-aedbd3121d3e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.322582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-44627df7-011d-458d-bc90-aedbd3121d3e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:47.323277 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-44627df7-011d-458d-bc90-aedbd3121d3e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.323731 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-44627df7-011d-458d-bc90-aedbd3121d3e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:47.361276 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-77576e7b-2df0-4454-9f5e-7b01463bf759 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d9eaad3-3c4f-4e98-b6c9-284f08f99292", "device": "/dev/sdb"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:47.362995 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-77576e7b-2df0-4454-9f5e-7b01463bf759 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:47.370083 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-77576e7b-2df0-4454-9f5e-7b01463bf759 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.370665 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-77576e7b-2df0-4454-9f5e-7b01463bf759 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:47.371555 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-77576e7b-2df0-4454-9f5e-7b01463bf759 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.372119 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-77576e7b-2df0-4454-9f5e-7b01463bf759 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:51.582619 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-77576e7b-2df0-4454-9f5e-7b01463bf759 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "POST /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.225414 Jul 24 01:14:51.585839 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-44627df7-011d-458d-bc90-aedbd3121d3e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.275501 Jul 24 01:14:51.586611 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 199/415] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:14:47 2022] POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/os-volume_attachments => generated 194 bytes in 4277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:51.588186 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 217/416] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:14:47 2022] POST /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559/os-volume_attachments => generated 194 bytes in 4232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:51.595487 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ec64d9dd-83ca-493c-9356-7712c18f2d85 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:51.596486 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ec64d9dd-83ca-493c-9356-7712c18f2d85 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:51.599189 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-04efa925-84aa-49e8-a0fa-49efe8302ef1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:51.605427 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ec64d9dd-83ca-493c-9356-7712c18f2d85 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:51.605641 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-04efa925-84aa-49e8-a0fa-49efe8302ef1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:51.606104 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ec64d9dd-83ca-493c-9356-7712c18f2d85 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:51.606697 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ec64d9dd-83ca-493c-9356-7712c18f2d85 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:51.607323 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ec64d9dd-83ca-493c-9356-7712c18f2d85 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:51.625494 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-04efa925-84aa-49e8-a0fa-49efe8302ef1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:51.626236 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-04efa925-84aa-49e8-a0fa-49efe8302ef1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:51.627312 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-04efa925-84aa-49e8-a0fa-49efe8302ef1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:51.628257 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-04efa925-84aa-49e8-a0fa-49efe8302ef1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:51.656255 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:51.801508 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ec64d9dd-83ca-493c-9356-7712c18f2d85 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:51.809643 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ec64d9dd-83ca-493c-9356-7712c18f2d85 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1497 microversion: 2.1 time: 0.219929 Jul 24 01:14:51.810806 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 218/417] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:51 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:51.816012 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-824312921", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcbaf71d-4a65-44d0-a781-ad7ed5a13863"}], "security_groups": [{"name": "tempest-securitygroup--227354723"}], "key_name": "tempest-keypair-1152461608", "user_data": "}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:51.840938 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-04efa925-84aa-49e8-a0fa-49efe8302ef1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:51.849694 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-04efa925-84aa-49e8-a0fa-49efe8302ef1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.261666 Jul 24 01:14:51.850275 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 200/418] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:51 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:51.938774 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.network.neutron [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] validate_networks() for [('fcbaf71d-4a65-44d0-a781-ad7ed5a13863', None, None, None, None, None)] {{(pid=118035) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:14:52.330274 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Flavor limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:14:52.330791 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Image limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:14:52.331337 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Flavor pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:14:52.331803 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Image pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:14:52.332348 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:14:52.342688 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.343173 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.344225 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.344667 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.363071 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:14:52.367442 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for user 1e7d0f401530454ba0cae0f5e9d6e0ce and project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:14:52.378941 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Going to run 1 instances... {{(pid=118035) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:14:52.381245 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118035) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:14:52.435617 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d7a21cff-df52-43f9-b9af-281873077b80 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.623453 Jul 24 01:14:52.441731 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 219/419] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:14:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:14:52.449858 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-95280639-dd4c-45f1-8f31-8d1806d2a9c0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:52.450540 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-95280639-dd4c-45f1-8f31-8d1806d2a9c0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:52.516160 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-95280639-dd4c-45f1-8f31-8d1806d2a9c0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:52.523352 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-95280639-dd4c-45f1-8f31-8d1806d2a9c0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1241 microversion: 2.1 time: 0.080839 Jul 24 01:14:52.523901 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 201/420] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:52 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:52.797659 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-47bdc300-c2be-4ac0-a299-58b8fcf99eb6 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:52.798263 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-47bdc300-c2be-4ac0-a299-58b8fcf99eb6 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:52.806311 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-47bdc300-c2be-4ac0-a299-58b8fcf99eb6 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.806758 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-47bdc300-c2be-4ac0-a299-58b8fcf99eb6 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.807996 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-47bdc300-c2be-4ac0-a299-58b8fcf99eb6 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.808425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-47bdc300-c2be-4ac0-a299-58b8fcf99eb6 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.837917 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-47bdc300-c2be-4ac0-a299-58b8fcf99eb6 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:14:52.866836 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c3ca4537-523f-40af-9c4f-7004ba857323 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:52.867430 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c3ca4537-523f-40af-9c4f-7004ba857323 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:52.873726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c3ca4537-523f-40af-9c4f-7004ba857323 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.874090 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c3ca4537-523f-40af-9c4f-7004ba857323 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.875621 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c3ca4537-523f-40af-9c4f-7004ba857323 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.875769 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c3ca4537-523f-40af-9c4f-7004ba857323 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.923940 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-47bdc300-c2be-4ac0-a299-58b8fcf99eb6 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 204 len: 0 microversion: 2.1 time: 0.140484 Jul 24 01:14:52.924637 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 220/421] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:14:52 2022] DELETE /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:14:52.935648 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-45ac2733-ea03-4315-a4b3-5c39f21c5bef tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:52.936550 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-45ac2733-ea03-4315-a4b3-5c39f21c5bef tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:52.943015 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-45ac2733-ea03-4315-a4b3-5c39f21c5bef tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.943657 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-45ac2733-ea03-4315-a4b3-5c39f21c5bef tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.944711 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-45ac2733-ea03-4315-a4b3-5c39f21c5bef tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.945212 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-45ac2733-ea03-4315-a4b3-5c39f21c5bef tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.082833 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c3ca4537-523f-40af-9c4f-7004ba857323 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:53.091257 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c3ca4537-523f-40af-9c4f-7004ba857323 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.229179 Jul 24 01:14:53.091905 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 202/422] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:52 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:53.116822 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-45ac2733-ea03-4315-a4b3-5c39f21c5bef tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:53.124492 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-45ac2733-ea03-4315-a4b3-5c39f21c5bef tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1503 microversion: 2.1 time: 0.194987 Jul 24 01:14:53.125044 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 221/423] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:52 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:53.541087 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e996dfd7-c286-4ec3-944c-3ab3ede96d85 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:53.541925 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e996dfd7-c286-4ec3-944c-3ab3ede96d85 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:53.549870 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e996dfd7-c286-4ec3-944c-3ab3ede96d85 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.550435 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e996dfd7-c286-4ec3-944c-3ab3ede96d85 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.551646 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e996dfd7-c286-4ec3-944c-3ab3ede96d85 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.552151 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e996dfd7-c286-4ec3-944c-3ab3ede96d85 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.656977 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e996dfd7-c286-4ec3-944c-3ab3ede96d85 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:53.665198 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e996dfd7-c286-4ec3-944c-3ab3ede96d85 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1245 microversion: 2.1 time: 0.128259 Jul 24 01:14:53.670165 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 203/424] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:53 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1245 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:54.113154 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-23f567ac-f4ee-4b01-8bad-7f52b1151ed3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:54.114027 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-23f567ac-f4ee-4b01-8bad-7f52b1151ed3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:54.125111 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-23f567ac-f4ee-4b01-8bad-7f52b1151ed3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:54.125870 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-23f567ac-f4ee-4b01-8bad-7f52b1151ed3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:54.127123 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-23f567ac-f4ee-4b01-8bad-7f52b1151ed3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:54.127906 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-23f567ac-f4ee-4b01-8bad-7f52b1151ed3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:54.141887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2f67e877-92a1-4ea1-943b-14945e9153ba tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:54.142499 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2f67e877-92a1-4ea1-943b-14945e9153ba tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:54.149054 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2f67e877-92a1-4ea1-943b-14945e9153ba tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:54.149498 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2f67e877-92a1-4ea1-943b-14945e9153ba tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:54.150250 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2f67e877-92a1-4ea1-943b-14945e9153ba tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:54.150678 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2f67e877-92a1-4ea1-943b-14945e9153ba tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:54.327102 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-23f567ac-f4ee-4b01-8bad-7f52b1151ed3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:54.335171 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-23f567ac-f4ee-4b01-8bad-7f52b1151ed3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.228585 Jul 24 01:14:54.335807 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 222/425] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:54 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:54.342627 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2f67e877-92a1-4ea1-943b-14945e9153ba tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:54.351861 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2f67e877-92a1-4ea1-943b-14945e9153ba tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1503 microversion: 2.1 time: 0.213757 Jul 24 01:14:54.352429 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 204/426] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:54 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:54.691747 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3476e09f-84bf-49fd-b857-853a3dccf652 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:54.692362 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3476e09f-84bf-49fd-b857-853a3dccf652 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:54.699141 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3476e09f-84bf-49fd-b857-853a3dccf652 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:54.699608 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3476e09f-84bf-49fd-b857-853a3dccf652 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:54.700541 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3476e09f-84bf-49fd-b857-853a3dccf652 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:54.700975 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3476e09f-84bf-49fd-b857-853a3dccf652 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:54.762597 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3476e09f-84bf-49fd-b857-853a3dccf652 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:54.770221 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3476e09f-84bf-49fd-b857-853a3dccf652 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1245 microversion: 2.1 time: 0.082496 Jul 24 01:14:54.770790 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 223/427] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:54 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:55.185433 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-3b30c194-52a2-492c-8e55-4e53b56f2d21 req-75f2da9b-e330-46a4-9ba8-0d8e37ce885f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d614ca48-40f2-4927-a2a9-65a14f2fe0a1", "name": "network-vif-plugged", "status": "completed", "tag": "f6ef1157-8359-4903-8874-ba4b3c99bee5"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:55.194673 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-3b30c194-52a2-492c-8e55-4e53b56f2d21 req-75f2da9b-e330-46a4-9ba8-0d8e37ce885f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:55.195205 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-3b30c194-52a2-492c-8e55-4e53b56f2d21 req-75f2da9b-e330-46a4-9ba8-0d8e37ce885f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:55.206588 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-3b30c194-52a2-492c-8e55-4e53b56f2d21 req-75f2da9b-e330-46a4-9ba8-0d8e37ce885f service nova] Creating event network-vif-plugged:f6ef1157-8359-4903-8874-ba4b3c99bee5 for instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 on hv-cinder-maste Jul 24 01:14:55.211369 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-3b30c194-52a2-492c-8e55-4e53b56f2d21 req-75f2da9b-e330-46a4-9ba8-0d8e37ce885f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029895 Jul 24 01:14:55.211965 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 205/428] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:55.356577 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1f0bff60-4f59-4470-9f1f-db5ce2113b38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:55.357607 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1f0bff60-4f59-4470-9f1f-db5ce2113b38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:55.368644 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1f0bff60-4f59-4470-9f1f-db5ce2113b38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:55.369351 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1f0bff60-4f59-4470-9f1f-db5ce2113b38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:55.370328 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1f0bff60-4f59-4470-9f1f-db5ce2113b38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:55.370759 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1f0bff60-4f59-4470-9f1f-db5ce2113b38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:55.375177 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-67ed4a10-b757-468f-9066-0321858c509f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:55.375918 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-67ed4a10-b757-468f-9066-0321858c509f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:55.382683 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67ed4a10-b757-468f-9066-0321858c509f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:55.383128 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67ed4a10-b757-468f-9066-0321858c509f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:55.383924 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67ed4a10-b757-468f-9066-0321858c509f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:55.384350 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67ed4a10-b757-468f-9066-0321858c509f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:55.557645 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1f0bff60-4f59-4470-9f1f-db5ce2113b38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:55.567246 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1f0bff60-4f59-4470-9f1f-db5ce2113b38 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.217049 Jul 24 01:14:55.567853 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 224/429] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:55 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:55.575110 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-67ed4a10-b757-468f-9066-0321858c509f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:55.583096 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-67ed4a10-b757-468f-9066-0321858c509f tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1503 microversion: 2.1 time: 0.212115 Jul 24 01:14:55.583697 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 206/430] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:55 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:55.791505 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-65debb4f-f506-422b-b744-6d660ffe0aef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:55.792252 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-65debb4f-f506-422b-b744-6d660ffe0aef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:55.799606 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-65debb4f-f506-422b-b744-6d660ffe0aef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:55.800123 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-65debb4f-f506-422b-b744-6d660ffe0aef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:55.800966 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-65debb4f-f506-422b-b744-6d660ffe0aef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:55.801781 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-65debb4f-f506-422b-b744-6d660ffe0aef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:55.865253 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-65debb4f-f506-422b-b744-6d660ffe0aef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:55.872947 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-65debb4f-f506-422b-b744-6d660ffe0aef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1237 microversion: 2.1 time: 0.088221 Jul 24 01:14:55.873515 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 225/431] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:55 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:56.585357 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b97be9f9-f6f4-4624-b459-e98a6248f8e5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:56.585950 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b97be9f9-f6f4-4624-b459-e98a6248f8e5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:56.594042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b97be9f9-f6f4-4624-b459-e98a6248f8e5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:56.595125 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b97be9f9-f6f4-4624-b459-e98a6248f8e5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:56.595951 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b97be9f9-f6f4-4624-b459-e98a6248f8e5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:56.596483 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b97be9f9-f6f4-4624-b459-e98a6248f8e5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:56.599661 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d906e290-77d5-4624-9bac-9afa6dfce5e3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:56.601010 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d906e290-77d5-4624-9bac-9afa6dfce5e3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:56.608392 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d906e290-77d5-4624-9bac-9afa6dfce5e3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:56.609173 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d906e290-77d5-4624-9bac-9afa6dfce5e3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:56.610234 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d906e290-77d5-4624-9bac-9afa6dfce5e3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:56.611000 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d906e290-77d5-4624-9bac-9afa6dfce5e3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:56.733424 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d906e290-77d5-4624-9bac-9afa6dfce5e3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:56.740899 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d906e290-77d5-4624-9bac-9afa6dfce5e3 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1461 microversion: 2.1 time: 0.145013 Jul 24 01:14:56.742048 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 226/432] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:56 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1461 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:56.890335 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-bb528ad9-4c7f-4aaf-aa0c-ccf1ae71b315 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:56.891001 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-bb528ad9-4c7f-4aaf-aa0c-ccf1ae71b315 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:56.907083 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bb528ad9-4c7f-4aaf-aa0c-ccf1ae71b315 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:56.907859 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bb528ad9-4c7f-4aaf-aa0c-ccf1ae71b315 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:56.908803 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bb528ad9-4c7f-4aaf-aa0c-ccf1ae71b315 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:56.910014 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bb528ad9-4c7f-4aaf-aa0c-ccf1ae71b315 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:56.938031 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:56.958581 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b97be9f9-f6f4-4624-b459-e98a6248f8e5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:56.969503 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b97be9f9-f6f4-4624-b459-e98a6248f8e5 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.388923 Jul 24 01:14:56.979591 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 207/433] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:56 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:56.985412 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-b3c344f4-b34a-40de-899a-9b4f958d0db3 req-d97b8b0e-5854-4b35-a1d8-253e770c6615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f92b499-7518-43eb-8031-a3dd9da5b9cb", "name": "network-vif-deleted", "tag": "09f6667f-1c33-4630-b272-6a88a5481894"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:57.001862 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-b3c344f4-b34a-40de-899a-9b4f958d0db3 req-d97b8b0e-5854-4b35-a1d8-253e770c6615 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.002492 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-b3c344f4-b34a-40de-899a-9b4f958d0db3 req-d97b8b0e-5854-4b35-a1d8-253e770c6615 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.017477 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-b3c344f4-b34a-40de-899a-9b4f958d0db3 req-d97b8b0e-5854-4b35-a1d8-253e770c6615 service nova] Creating event network-vif-deleted:09f6667f-1c33-4630-b272-6a88a5481894 for instance 5f92b499-7518-43eb-8031-a3dd9da5b9cb on hv-cinder-maste Jul 24 01:14:57.022939 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-b3c344f4-b34a-40de-899a-9b4f958d0db3 req-d97b8b0e-5854-4b35-a1d8-253e770c6615 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041043 Jul 24 01:14:57.023574 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 208/434] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:57.035237 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-bb528ad9-4c7f-4aaf-aa0c-ccf1ae71b315 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:57.046166 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-bb528ad9-4c7f-4aaf-aa0c-ccf1ae71b315 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1311 microversion: 2.1 time: 0.159752 Jul 24 01:14:57.056260 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 227/435] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:56 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:57.135010 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-fad901c8-8218-421c-a0ba-6b34d54a4384 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:57.141416 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fad901c8-8218-421c-a0ba-6b34d54a4384 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.141851 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fad901c8-8218-421c-a0ba-6b34d54a4384 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.207500 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-fad901c8-8218-421c-a0ba-6b34d54a4384 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Going to try to stop instance {{(pid=118036) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:14:57.253433 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-fad901c8-8218-421c-a0ba-6b34d54a4384 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/action" status: 202 len: 0 microversion: 2.1 time: 0.122563 Jul 24 01:14:57.254142 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 209/436] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:14:57 2022] POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:57.271119 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3d7f66ad-3993-4daf-bac1-32ada398f074 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:57.271795 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3d7f66ad-3993-4daf-bac1-32ada398f074 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:57.278559 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3d7f66ad-3993-4daf-bac1-32ada398f074 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.279011 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3d7f66ad-3993-4daf-bac1-32ada398f074 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.279854 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3d7f66ad-3993-4daf-bac1-32ada398f074 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.280289 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3d7f66ad-3993-4daf-bac1-32ada398f074 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.412083 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3d7f66ad-3993-4daf-bac1-32ada398f074 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:57.420118 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3d7f66ad-3993-4daf-bac1-32ada398f074 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1725 microversion: 2.1 time: 0.154977 Jul 24 01:14:57.420663 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 228/437] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:57 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:57.759472 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:57.760414 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:57.766702 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.767386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.768602 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.768908 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.806635 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.807179 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.807648 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lazy-loading 'fault' on Instance uuid 5f92b499-7518-43eb-8031-a3dd9da5b9cb {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:14:57.863515 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:57.871841 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-dc3b6c3f-176f-4451-9e24-511d86b4df45 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1303 microversion: 2.1 time: 0.117158 Jul 24 01:14:57.872595 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 210/438] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:57 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:57.965571 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-1c85f3e3-9fd4-41f3-98c4-407bc4699818 req-62e9dd21-a649-439e-9aec-7f5dd4bc193e admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "8d9eaad3-3c4f-4e98-b6c9-284f08f99292", "create_info": {"type": "qcow2", "new_file": "volume-8d9eaad3-3c4f-4e98-b6c9-284f08f99292.acbd9a34-c0dc-40fd-8f41-59a156452330.vhdx", "snapshot_id": "acbd9a34-c0dc-40fd-8f41-59a156452330"}}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:57.968777 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:57.974235 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [req-1c85f3e3-9fd4-41f3-98c4-407bc4699818 req-62e9dd21-a649-439e-9aec-7f5dd4bc193e admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0485860-44f6-4783-97a7-f4dbef82a919(cell1) {{(pid=118035) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 24 01:14:57.974721 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-1c85f3e3-9fd4-41f3-98c4-407bc4699818 req-62e9dd21-a649-439e-9aec-7f5dd4bc193e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.975189 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-1c85f3e3-9fd4-41f3-98c4-407bc4699818 req-62e9dd21-a649-439e-9aec-7f5dd4bc193e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.987083 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-278a2551-8697-4621-a700-71890095fb8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:57.987754 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-278a2551-8697-4621-a700-71890095fb8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:57.995510 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-278a2551-8697-4621-a700-71890095fb8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.995990 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-278a2551-8697-4621-a700-71890095fb8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.996902 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-278a2551-8697-4621-a700-71890095fb8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:57.997386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-278a2551-8697-4621-a700-71890095fb8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.020400 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-1c85f3e3-9fd4-41f3-98c4-407bc4699818 req-62e9dd21-a649-439e-9aec-7f5dd4bc193e admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.020825 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-1c85f3e3-9fd4-41f3-98c4-407bc4699818 req-62e9dd21-a649-439e-9aec-7f5dd4bc193e admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.045927 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-1c85f3e3-9fd4-41f3-98c4-407bc4699818 req-62e9dd21-a649-439e-9aec-7f5dd4bc193e admin admin] 10.222.0.20 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.200541 Jul 24 01:14:58.046535 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 229/439] 10.222.0.20 () {64 vars in 1326 bytes} [Sun Jul 24 01:14:57 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:14:58.064757 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1b5b7559-87cc-49e2-9a85-63ae565cfec7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:58.065390 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1b5b7559-87cc-49e2-9a85-63ae565cfec7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:58.071939 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1b5b7559-87cc-49e2-9a85-63ae565cfec7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.072785 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1b5b7559-87cc-49e2-9a85-63ae565cfec7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.073559 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1b5b7559-87cc-49e2-9a85-63ae565cfec7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.073996 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1b5b7559-87cc-49e2-9a85-63ae565cfec7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.195197 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-278a2551-8697-4621-a700-71890095fb8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:58.206047 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-278a2551-8697-4621-a700-71890095fb8e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.221655 Jul 24 01:14:58.207724 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 211/440] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:57 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:58.273975 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1b5b7559-87cc-49e2-9a85-63ae565cfec7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:58.284111 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1b5b7559-87cc-49e2-9a85-63ae565cfec7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.223789 Jul 24 01:14:58.284867 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 230/441] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:58 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:58.438556 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-eb8a3d19-27b1-4b81-acee-3fa72335b2ca tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:58.439102 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-eb8a3d19-27b1-4b81-acee-3fa72335b2ca tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:58.445754 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb8a3d19-27b1-4b81-acee-3fa72335b2ca tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.446200 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb8a3d19-27b1-4b81-acee-3fa72335b2ca tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.448168 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb8a3d19-27b1-4b81-acee-3fa72335b2ca tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.448647 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb8a3d19-27b1-4b81-acee-3fa72335b2ca tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.583698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-eb8a3d19-27b1-4b81-acee-3fa72335b2ca tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:58.593360 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-eb8a3d19-27b1-4b81-acee-3fa72335b2ca tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1725 microversion: 2.1 time: 0.158900 Jul 24 01:14:58.593890 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 212/442] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:58 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:58.889275 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:58.889918 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:58.896807 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.897257 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.898019 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.898444 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.930575 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.931027 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.931554 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lazy-loading 'fault' on Instance uuid 5f92b499-7518-43eb-8031-a3dd9da5b9cb {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:14:58.977160 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:58.984890 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7ed0372f-53e3-446d-a269-4302a7ed9e94 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1303 microversion: 2.1 time: 0.099708 Jul 24 01:14:58.985546 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 231/443] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:58 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:59.223035 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-02e9192a-8955-43df-8b23-36d9d5d4d2ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:59.223807 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-02e9192a-8955-43df-8b23-36d9d5d4d2ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:59.231495 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-02e9192a-8955-43df-8b23-36d9d5d4d2ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:59.232005 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-02e9192a-8955-43df-8b23-36d9d5d4d2ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:59.232902 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-02e9192a-8955-43df-8b23-36d9d5d4d2ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:59.233467 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-02e9192a-8955-43df-8b23-36d9d5d4d2ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:59.242184 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-ca0ff979-57ce-4ede-bfbf-ce819d9b8813 req-fe744ba2-b50b-4bbc-bb44-7061d4e2cc36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74d4adf-6c79-421f-b475-3eb478eb2124", "tag": "0cc7ea74-2a38-44cd-bfab-54da31684bd5"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:59.250998 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ca0ff979-57ce-4ede-bfbf-ce819d9b8813 req-fe744ba2-b50b-4bbc-bb44-7061d4e2cc36 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:59.251802 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ca0ff979-57ce-4ede-bfbf-ce819d9b8813 req-fe744ba2-b50b-4bbc-bb44-7061d4e2cc36 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:59.264160 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-ca0ff979-57ce-4ede-bfbf-ce819d9b8813 req-fe744ba2-b50b-4bbc-bb44-7061d4e2cc36 service nova] Creating event network-changed:0cc7ea74-2a38-44cd-bfab-54da31684bd5 for instance c74d4adf-6c79-421f-b475-3eb478eb2124 on hv-cinder-maste Jul 24 01:14:59.268744 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-ca0ff979-57ce-4ede-bfbf-ce819d9b8813 req-fe744ba2-b50b-4bbc-bb44-7061d4e2cc36 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030261 Jul 24 01:14:59.269747 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 232/444] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:59.302532 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f46c266c-9a63-4800-85cc-da93633f7c93 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:59.303237 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f46c266c-9a63-4800-85cc-da93633f7c93 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:59.310148 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f46c266c-9a63-4800-85cc-da93633f7c93 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:59.310686 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f46c266c-9a63-4800-85cc-da93633f7c93 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:59.311590 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f46c266c-9a63-4800-85cc-da93633f7c93 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:59.312257 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f46c266c-9a63-4800-85cc-da93633f7c93 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:59.428156 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-02e9192a-8955-43df-8b23-36d9d5d4d2ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:59.437293 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-02e9192a-8955-43df-8b23-36d9d5d4d2ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1371 microversion: 2.1 time: 0.218099 Jul 24 01:14:59.438406 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 213/445] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:59 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:59.488658 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f46c266c-9a63-4800-85cc-da93633f7c93 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:59.497545 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f46c266c-9a63-4800-85cc-da93633f7c93 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.199764 Jul 24 01:14:59.498160 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 233/446] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:59 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:59.610088 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d0593551-db5c-472e-8288-ea1d1b62a914 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:59.610619 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d0593551-db5c-472e-8288-ea1d1b62a914 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:59.616757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d0593551-db5c-472e-8288-ea1d1b62a914 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:59.617223 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d0593551-db5c-472e-8288-ea1d1b62a914 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:59.617971 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d0593551-db5c-472e-8288-ea1d1b62a914 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:59.618396 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d0593551-db5c-472e-8288-ea1d1b62a914 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.003509 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:00.004810 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:00.011953 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:00.012412 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.013320 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:00.013757 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.042656 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d0593551-db5c-472e-8288-ea1d1b62a914 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:00.048277 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:00.048730 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.049238 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lazy-loading 'fault' on Instance uuid 5f92b499-7518-43eb-8031-a3dd9da5b9cb {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:00.051490 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d0593551-db5c-472e-8288-ea1d1b62a914 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1725 microversion: 2.1 time: 0.444818 Jul 24 01:15:00.061383 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 214/447] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:59 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1725 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:00.098934 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:00.109782 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a03d043e-de1e-41f9-9e0c-693bb9ef7458 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1303 microversion: 2.1 time: 0.109972 Jul 24 01:15:00.110725 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 234/448] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:59 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:00.455570 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-54aabe93-a509-4375-9245-a095a2460764 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:00.456195 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-54aabe93-a509-4375-9245-a095a2460764 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:00.463842 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-54aabe93-a509-4375-9245-a095a2460764 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:00.464387 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-54aabe93-a509-4375-9245-a095a2460764 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.465238 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-54aabe93-a509-4375-9245-a095a2460764 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:00.465669 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-54aabe93-a509-4375-9245-a095a2460764 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.515069 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-20b86c4a-ba80-41a3-8c8c-56610df2e035 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:00.515069 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-20b86c4a-ba80-41a3-8c8c-56610df2e035 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:00.521740 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-20b86c4a-ba80-41a3-8c8c-56610df2e035 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:00.522216 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-20b86c4a-ba80-41a3-8c8c-56610df2e035 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.522992 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-20b86c4a-ba80-41a3-8c8c-56610df2e035 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:00.523419 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-20b86c4a-ba80-41a3-8c8c-56610df2e035 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.663510 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-54aabe93-a509-4375-9245-a095a2460764 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:00.671275 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-54aabe93-a509-4375-9245-a095a2460764 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1564 microversion: 2.1 time: 0.220431 Jul 24 01:15:00.671882 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 215/449] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:00 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1564 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:00.688140 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4ad20a75-4ac5-41ba-95c9-2ecd4c400c10 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:00.688636 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4ad20a75-4ac5-41ba-95c9-2ecd4c400c10 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:00.689510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-20b86c4a-ba80-41a3-8c8c-56610df2e035 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:00.694918 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4ad20a75-4ac5-41ba-95c9-2ecd4c400c10 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:00.695405 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4ad20a75-4ac5-41ba-95c9-2ecd4c400c10 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.696178 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4ad20a75-4ac5-41ba-95c9-2ecd4c400c10 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:00.696612 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4ad20a75-4ac5-41ba-95c9-2ecd4c400c10 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.697132 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-20b86c4a-ba80-41a3-8c8c-56610df2e035 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.186773 Jul 24 01:15:00.697738 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 235/450] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:00 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:00.771951 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4ad20a75-4ac5-41ba-95c9-2ecd4c400c10 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087513 Jul 24 01:15:00.772616 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 216/451] 10.222.0.42 () {58 vars in 1274 bytes} [Sun Jul 24 01:15:00 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:01.068440 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8daa6ac5-3274-4488-8042-5227e7b66ed7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:01.069175 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8daa6ac5-3274-4488-8042-5227e7b66ed7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:01.076194 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8daa6ac5-3274-4488-8042-5227e7b66ed7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.076640 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8daa6ac5-3274-4488-8042-5227e7b66ed7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:01.077398 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8daa6ac5-3274-4488-8042-5227e7b66ed7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.077825 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8daa6ac5-3274-4488-8042-5227e7b66ed7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:01.126796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:01.127599 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:01.133974 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.134688 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:01.135564 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.136066 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:01.167339 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.167804 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:01.168229 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lazy-loading 'fault' on Instance uuid 5f92b499-7518-43eb-8031-a3dd9da5b9cb {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:01.229265 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e654fe35564c52878bc60880954dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb22bb3227a42cd8cce008519e7f870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:01.240788 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b43a684f-6136-48df-8b20-fc8443abefd2 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 200 len: 1303 microversion: 2.1 time: 0.116070 Jul 24 01:15:01.241636 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 217/452] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:01 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:01.363521 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8daa6ac5-3274-4488-8042-5227e7b66ed7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:01.372050 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8daa6ac5-3274-4488-8042-5227e7b66ed7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1725 microversion: 2.1 time: 0.307639 Jul 24 01:15:01.372630 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 236/453] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:01 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1725 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:01.714695 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c25c3533-f8fa-4453-9da5-28131bbd156f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:01.715287 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c25c3533-f8fa-4453-9da5-28131bbd156f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:01.723330 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c25c3533-f8fa-4453-9da5-28131bbd156f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.723772 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c25c3533-f8fa-4453-9da5-28131bbd156f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:01.724530 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c25c3533-f8fa-4453-9da5-28131bbd156f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.724960 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c25c3533-f8fa-4453-9da5-28131bbd156f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:01.729322 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:01.944764 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c25c3533-f8fa-4453-9da5-28131bbd156f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:01.953070 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-0582ef8d-3c3c-487a-960e-80a4b7451a70 req-53ee1c59-a9c2-4ebb-961d-6f041acf7bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d614ca48-40f2-4927-a2a9-65a14f2fe0a1", "tag": "f6ef1157-8359-4903-8874-ba4b3c99bee5"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:01.960446 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c25c3533-f8fa-4453-9da5-28131bbd156f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.248687 Jul 24 01:15:01.960914 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-0582ef8d-3c3c-487a-960e-80a4b7451a70 req-53ee1c59-a9c2-4ebb-961d-6f041acf7bd2 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.961658 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-0582ef8d-3c3c-487a-960e-80a4b7451a70 req-53ee1c59-a9c2-4ebb-961d-6f041acf7bd2 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:01.972457 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 218/454] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:01 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:01.974271 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-0582ef8d-3c3c-487a-960e-80a4b7451a70 req-53ee1c59-a9c2-4ebb-961d-6f041acf7bd2 service nova] Creating event network-changed:f6ef1157-8359-4903-8874-ba4b3c99bee5 for instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 on hv-cinder-maste Jul 24 01:15:01.979629 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-0582ef8d-3c3c-487a-960e-80a4b7451a70 req-53ee1c59-a9c2-4ebb-961d-6f041acf7bd2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030296 Jul 24 01:15:01.980904 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 237/455] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:02.259124 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:02.259861 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] [instance: 5f92b499-7518-43eb-8031-a3dd9da5b9cb] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:02.268172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:02.268628 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:02.271171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:02.271690 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:02.289459 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] HTTP exception thrown: Instance 5f92b499-7518-43eb-8031-a3dd9da5b9cb could not be found. Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Request method failure captured: Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb HTTP/1.1 Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JzKDKUUQ8o8hKOCpDFpIjJbujM3HA4jH-zkl422P-msO8PZoQ4qQqU5rLQyWrexaZABX1x76oeIUBFAR1NNnHo4H6frW38sHBQoM37yAmOKlR_jvXl58d6G6UbkyVQMxZ1vRY8OGUiahlVTTF8N86NV3Acr7If40PR9BWPM8Vg62_I Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: eeb22bb3227a42cd8cce008519e7f870 Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesActionsTest-675412498 Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:15:02.291639 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eeb22bb3227a42cd8cce008519e7f870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eeb22bb3227a42cd8cce008519e7f870", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eeb22bb3227a42cd8cce008519e7f870"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eeb22bb3227a42cd8cce008519e7f870"}]}] Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesActionsTest-675412498 Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: eeb22bb3227a42cd8cce008519e7f870 Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesActionsTest-675412498 Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesActionsTest-675412498-project Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: b7e654fe35564c52878bc60880954dde Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesActionsTest-675412498-project Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 5f92b499-7518-43eb-8031-a3dd9da5b9cb could not be found. Jul 24 01:15:02.292976 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '5f92b499-7518-43eb-8031-a3dd9da5b9cb'} Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f92b499-7518-43eb-8031-a3dd9da5b9cb could not be found. Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:15:02.293840 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f92b499-7518-43eb-8031-a3dd9da5b9cb could not be found. Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f92b499-7518-43eb-8031-a3dd9da5b9cb could not be found. Jul 24 01:15:02.295075 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:15:02.296295 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] Returning 404 to user: Instance 5f92b499-7518-43eb-8031-a3dd9da5b9cb could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:15:02.296295 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6913030d-2c26-46bc-8ab9-69d9fd3b1a24 tempest-VolumesActionsTest-675412498 tempest-VolumesActionsTest-675412498-project] 10.222.0.42 "GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb" status: 404 len: 111 microversion: 2.1 time: 0.040106 Jul 24 01:15:02.296295 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 219/456] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:02 2022] GET /compute/v2.1/servers/5f92b499-7518-43eb-8031-a3dd9da5b9cb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:15:02.390140 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d4ca2d33-3241-4173-93d9-9c0cf540d352 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:02.390758 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d4ca2d33-3241-4173-93d9-9c0cf540d352 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:02.397063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=10 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:02.398799 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4ca2d33-3241-4173-93d9-9c0cf540d352 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:02.399480 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4ca2d33-3241-4173-93d9-9c0cf540d352 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:02.400465 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4ca2d33-3241-4173-93d9-9c0cf540d352 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:02.401082 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d4ca2d33-3241-4173-93d9-9c0cf540d352 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:02.655325 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d4ca2d33-3241-4173-93d9-9c0cf540d352 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:02.667035 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d4ca2d33-3241-4173-93d9-9c0cf540d352 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1725 microversion: 2.1 time: 0.281291 Jul 24 01:15:02.672619 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 238/457] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:02 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1725 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:02.993704 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-efd03845-3ff4-4fbf-b914-3460594b42f8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:02.994388 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-efd03845-3ff4-4fbf-b914-3460594b42f8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:02.996510 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:03.002810 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-efd03845-3ff4-4fbf-b914-3460594b42f8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:03.003672 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-efd03845-3ff4-4fbf-b914-3460594b42f8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:03.004672 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-efd03845-3ff4-4fbf-b914-3460594b42f8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:03.005246 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-efd03845-3ff4-4fbf-b914-3460594b42f8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:03.180210 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-efd03845-3ff4-4fbf-b914-3460594b42f8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:03.188350 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-efd03845-3ff4-4fbf-b914-3460594b42f8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.214140 Jul 24 01:15:03.189053 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 220/458] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:02 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:03.197042 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-dcfd96bc-3558-4384-a63d-73a981eba14f req-79c54070-64df-46ab-af55-e61880d40e2c admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "8d9eaad3-3c4f-4e98-b6c9-284f08f99292", "create_info": {"type": "qcow2", "new_file": "volume-8d9eaad3-3c4f-4e98-b6c9-284f08f99292.4b160ade-dd37-4392-8949-c7e8e126f114.vhdx", "snapshot_id": "4b160ade-dd37-4392-8949-c7e8e126f114"}}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:03.199199 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-dcfd96bc-3558-4384-a63d-73a981eba14f req-79c54070-64df-46ab-af55-e61880d40e2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:03.199880 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-dcfd96bc-3558-4384-a63d-73a981eba14f req-79c54070-64df-46ab-af55-e61880d40e2c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:03.208023 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-dcfd96bc-3558-4384-a63d-73a981eba14f req-79c54070-64df-46ab-af55-e61880d40e2c admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:03.208473 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-dcfd96bc-3558-4384-a63d-73a981eba14f req-79c54070-64df-46ab-af55-e61880d40e2c admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:03.221662 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-dcfd96bc-3558-4384-a63d-73a981eba14f req-79c54070-64df-46ab-af55-e61880d40e2c admin admin] 10.222.0.20 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.186054 Jul 24 01:15:03.222283 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 239/459] 10.222.0.20 () {64 vars in 1326 bytes} [Sun Jul 24 01:15:03 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:15:03.693478 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ba869bea-a3f0-4248-8577-513128717645 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:03.694484 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ba869bea-a3f0-4248-8577-513128717645 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:03.697661 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:03.703005 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ba869bea-a3f0-4248-8577-513128717645 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:03.703472 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ba869bea-a3f0-4248-8577-513128717645 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:03.704229 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ba869bea-a3f0-4248-8577-513128717645 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:03.704662 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ba869bea-a3f0-4248-8577-513128717645 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:03.840268 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ba869bea-a3f0-4248-8577-513128717645 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:03.853967 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ba869bea-a3f0-4248-8577-513128717645 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1725 microversion: 2.1 time: 0.167284 Jul 24 01:15:03.854531 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 221/460] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:03 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:04.211885 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-899cb95f-697b-47bf-a735-a780318fb901 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:04.213023 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-899cb95f-697b-47bf-a735-a780318fb901 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:04.220440 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-899cb95f-697b-47bf-a735-a780318fb901 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:04.220907 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-899cb95f-697b-47bf-a735-a780318fb901 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:04.221700 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-899cb95f-697b-47bf-a735-a780318fb901 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:04.222150 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-899cb95f-697b-47bf-a735-a780318fb901 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:04.358260 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-899cb95f-697b-47bf-a735-a780318fb901 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:04.365826 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-899cb95f-697b-47bf-a735-a780318fb901 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.161940 Jul 24 01:15:04.366398 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 240/461] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:04 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:04.880568 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c435a43a-2c8b-4b1d-b49e-b2e5ea501510 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:04.881437 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c435a43a-2c8b-4b1d-b49e-b2e5ea501510 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:04.890750 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c435a43a-2c8b-4b1d-b49e-b2e5ea501510 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:04.891240 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c435a43a-2c8b-4b1d-b49e-b2e5ea501510 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:04.892301 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c435a43a-2c8b-4b1d-b49e-b2e5ea501510 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:04.892961 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c435a43a-2c8b-4b1d-b49e-b2e5ea501510 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:05.075932 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c435a43a-2c8b-4b1d-b49e-b2e5ea501510 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:05.084501 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c435a43a-2c8b-4b1d-b49e-b2e5ea501510 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1725 microversion: 2.1 time: 0.209726 Jul 24 01:15:05.094630 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 222/462] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:04 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:05.382590 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1568fe35-698c-4b2f-bb12-55f3f6befdd7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:05.383596 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1568fe35-698c-4b2f-bb12-55f3f6befdd7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:05.390842 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1568fe35-698c-4b2f-bb12-55f3f6befdd7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:05.393081 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1568fe35-698c-4b2f-bb12-55f3f6befdd7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:05.393081 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1568fe35-698c-4b2f-bb12-55f3f6befdd7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:05.393081 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1568fe35-698c-4b2f-bb12-55f3f6befdd7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:05.566141 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1568fe35-698c-4b2f-bb12-55f3f6befdd7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:05.578790 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1568fe35-698c-4b2f-bb12-55f3f6befdd7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.200126 Jul 24 01:15:05.580287 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 241/463] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:05 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:06.105690 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2b1a40f5-47c3-4f45-a1f4-3a11b9f99699 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:06.107206 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2b1a40f5-47c3-4f45-a1f4-3a11b9f99699 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:06.114838 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2b1a40f5-47c3-4f45-a1f4-3a11b9f99699 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:06.116163 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2b1a40f5-47c3-4f45-a1f4-3a11b9f99699 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:06.116983 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2b1a40f5-47c3-4f45-a1f4-3a11b9f99699 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:06.117493 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2b1a40f5-47c3-4f45-a1f4-3a11b9f99699 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:06.318965 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2b1a40f5-47c3-4f45-a1f4-3a11b9f99699 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:06.328249 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2b1a40f5-47c3-4f45-a1f4-3a11b9f99699 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1725 microversion: 2.1 time: 0.226860 Jul 24 01:15:06.329918 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 223/464] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:06 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:06.598336 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9380543b-689a-483e-bdf0-61aafc25fea7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:06.599863 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9380543b-689a-483e-bdf0-61aafc25fea7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:06.607828 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9380543b-689a-483e-bdf0-61aafc25fea7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:06.608651 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9380543b-689a-483e-bdf0-61aafc25fea7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:06.609788 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9380543b-689a-483e-bdf0-61aafc25fea7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:06.610225 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9380543b-689a-483e-bdf0-61aafc25fea7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:06.773456 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9380543b-689a-483e-bdf0-61aafc25fea7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:06.782020 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9380543b-689a-483e-bdf0-61aafc25fea7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.188482 Jul 24 01:15:06.783245 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 242/465] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:06 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:07.349588 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2d85cae9-3832-40ef-ad99-6d1b32929373 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:07.350219 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2d85cae9-3832-40ef-ad99-6d1b32929373 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:07.356876 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2d85cae9-3832-40ef-ad99-6d1b32929373 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:07.357316 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2d85cae9-3832-40ef-ad99-6d1b32929373 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:07.358040 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2d85cae9-3832-40ef-ad99-6d1b32929373 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:07.358485 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2d85cae9-3832-40ef-ad99-6d1b32929373 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:07.504523 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2d85cae9-3832-40ef-ad99-6d1b32929373 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:07.513365 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2d85cae9-3832-40ef-ad99-6d1b32929373 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1725 microversion: 2.1 time: 0.168063 Jul 24 01:15:07.523170 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 224/466] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:07 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:07.805133 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3cd1b465-7e34-43df-b502-b0dc5930268f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:07.805723 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3cd1b465-7e34-43df-b502-b0dc5930268f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:07.824426 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3cd1b465-7e34-43df-b502-b0dc5930268f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:07.825020 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3cd1b465-7e34-43df-b502-b0dc5930268f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:07.827069 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3cd1b465-7e34-43df-b502-b0dc5930268f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:07.829692 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3cd1b465-7e34-43df-b502-b0dc5930268f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:07.999270 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3cd1b465-7e34-43df-b502-b0dc5930268f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:08.007990 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3cd1b465-7e34-43df-b502-b0dc5930268f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.207084 Jul 24 01:15:08.009185 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 243/467] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:07 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:08.530308 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-36dd0d8c-7f9b-4ad4-873a-355e4001aa6f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:08.530999 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-36dd0d8c-7f9b-4ad4-873a-355e4001aa6f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:08.541411 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-36dd0d8c-7f9b-4ad4-873a-355e4001aa6f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:08.542544 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-36dd0d8c-7f9b-4ad4-873a-355e4001aa6f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:08.543535 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-36dd0d8c-7f9b-4ad4-873a-355e4001aa6f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:08.544025 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-36dd0d8c-7f9b-4ad4-873a-355e4001aa6f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:08.695845 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-36dd0d8c-7f9b-4ad4-873a-355e4001aa6f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:08.706473 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-36dd0d8c-7f9b-4ad4-873a-355e4001aa6f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1702 microversion: 2.1 time: 0.179585 Jul 24 01:15:08.718262 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 225/468] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:08 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1702 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:08.725489 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4da55c80-75fa-4685-9520-fab07361a500 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:08.734743 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4da55c80-75fa-4685-9520-fab07361a500 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:08.735474 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4da55c80-75fa-4685-9520-fab07361a500 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:08.829111 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4da55c80-75fa-4685-9520-fab07361a500 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Going to try to start instance {{(pid=118035) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 24 01:15:08.889353 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4da55c80-75fa-4685-9520-fab07361a500 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/action" status: 202 len: 0 microversion: 2.1 time: 0.169782 Jul 24 01:15:08.890002 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 244/469] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:15:08 2022] POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:15:08.900136 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c0cd7f4c-bb06-4769-a764-41fe9220bc14 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:08.900806 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c0cd7f4c-bb06-4769-a764-41fe9220bc14 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:08.907876 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c0cd7f4c-bb06-4769-a764-41fe9220bc14 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:08.908331 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c0cd7f4c-bb06-4769-a764-41fe9220bc14 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:08.909900 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c0cd7f4c-bb06-4769-a764-41fe9220bc14 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:08.910487 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c0cd7f4c-bb06-4769-a764-41fe9220bc14 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:09.026080 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-84d82677-f8ba-4255-9536-dc40b5c9c5b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:09.028735 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-84d82677-f8ba-4255-9536-dc40b5c9c5b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:09.040736 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-84d82677-f8ba-4255-9536-dc40b5c9c5b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:09.041210 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-84d82677-f8ba-4255-9536-dc40b5c9c5b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:09.045589 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-84d82677-f8ba-4255-9536-dc40b5c9c5b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:09.046535 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-84d82677-f8ba-4255-9536-dc40b5c9c5b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:09.057529 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:09.168268 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c0cd7f4c-bb06-4769-a764-41fe9220bc14 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:09.220231 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c0cd7f4c-bb06-4769-a764-41fe9220bc14 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1711 microversion: 2.1 time: 0.324032 Jul 24 01:15:09.220827 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 226/470] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:08 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1711 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:09.250325 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-84d82677-f8ba-4255-9536-dc40b5c9c5b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:09.261521 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-84d82677-f8ba-4255-9536-dc40b5c9c5b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.240334 Jul 24 01:15:09.262722 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 245/471] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:09 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:09.415604 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-0632584e-648b-478d-af7a-c3daeceb1da1 req-72414bc8-455a-4428-b86f-be61dab0e858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74d4adf-6c79-421f-b475-3eb478eb2124", "name": "network-vif-plugged", "status": "completed", "tag": "0cc7ea74-2a38-44cd-bfab-54da31684bd5"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:09.432288 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0632584e-648b-478d-af7a-c3daeceb1da1 req-72414bc8-455a-4428-b86f-be61dab0e858 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:09.432688 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0632584e-648b-478d-af7a-c3daeceb1da1 req-72414bc8-455a-4428-b86f-be61dab0e858 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:09.461226 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-0632584e-648b-478d-af7a-c3daeceb1da1 req-72414bc8-455a-4428-b86f-be61dab0e858 service nova] Creating event network-vif-plugged:0cc7ea74-2a38-44cd-bfab-54da31684bd5 for instance c74d4adf-6c79-421f-b475-3eb478eb2124 on hv-cinder-maste Jul 24 01:15:09.473012 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-0632584e-648b-478d-af7a-c3daeceb1da1 req-72414bc8-455a-4428-b86f-be61dab0e858 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061875 Jul 24 01:15:09.473907 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 227/472] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:09.604297 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-f2cdecdc-39c9-4713-8eb2-10cc610aa7b2 req-8bab0afa-4ea2-4ed1-95e8-3d5f4b6b9c9d admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "8d9eaad3-3c4f-4e98-b6c9-284f08f99292", "create_info": {"type": "qcow2", "new_file": "volume-8d9eaad3-3c4f-4e98-b6c9-284f08f99292.ce4beb3c-03b5-45e9-9bf1-6a42857904c4.vhdx", "snapshot_id": "ce4beb3c-03b5-45e9-9bf1-6a42857904c4"}}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:09.606869 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-f2cdecdc-39c9-4713-8eb2-10cc610aa7b2 req-8bab0afa-4ea2-4ed1-95e8-3d5f4b6b9c9d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:09.607510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-f2cdecdc-39c9-4713-8eb2-10cc610aa7b2 req-8bab0afa-4ea2-4ed1-95e8-3d5f4b6b9c9d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:09.626343 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-f2cdecdc-39c9-4713-8eb2-10cc610aa7b2 req-8bab0afa-4ea2-4ed1-95e8-3d5f4b6b9c9d admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:09.631844 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-f2cdecdc-39c9-4713-8eb2-10cc610aa7b2 req-8bab0afa-4ea2-4ed1-95e8-3d5f4b6b9c9d admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:09.659624 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-f2cdecdc-39c9-4713-8eb2-10cc610aa7b2 req-8bab0afa-4ea2-4ed1-95e8-3d5f4b6b9c9d admin admin] 10.222.0.20 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.148563 Jul 24 01:15:09.666602 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 246/473] 10.222.0.20 () {64 vars in 1326 bytes} [Sun Jul 24 01:15:09 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:15:10.240754 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-799ba32a-9be5-4153-913f-0578c2c9db5f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:10.241588 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-799ba32a-9be5-4153-913f-0578c2c9db5f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:10.248980 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-799ba32a-9be5-4153-913f-0578c2c9db5f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:10.249567 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-799ba32a-9be5-4153-913f-0578c2c9db5f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:10.250441 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-799ba32a-9be5-4153-913f-0578c2c9db5f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:10.251098 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-799ba32a-9be5-4153-913f-0578c2c9db5f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:10.278877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f9faa9ac-8719-4eb4-a7ed-21b1657f47a3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:10.279633 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f9faa9ac-8719-4eb4-a7ed-21b1657f47a3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:10.287894 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9faa9ac-8719-4eb4-a7ed-21b1657f47a3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:10.288613 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9faa9ac-8719-4eb4-a7ed-21b1657f47a3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:10.289586 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9faa9ac-8719-4eb4-a7ed-21b1657f47a3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:10.293618 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9faa9ac-8719-4eb4-a7ed-21b1657f47a3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:10.490078 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-799ba32a-9be5-4153-913f-0578c2c9db5f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:10.500156 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f9faa9ac-8719-4eb4-a7ed-21b1657f47a3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:10.501546 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-799ba32a-9be5-4153-913f-0578c2c9db5f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1711 microversion: 2.1 time: 0.267149 Jul 24 01:15:10.502477 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 228/474] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:10 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1711 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:10.520659 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f9faa9ac-8719-4eb4-a7ed-21b1657f47a3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.246032 Jul 24 01:15:10.521554 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 247/475] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:10 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:11.520511 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a6b0837d-804b-4460-90a8-f9920843651b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:11.521142 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a6b0837d-804b-4460-90a8-f9920843651b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:11.528935 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a6b0837d-804b-4460-90a8-f9920843651b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:11.529631 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a6b0837d-804b-4460-90a8-f9920843651b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:11.531920 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a6b0837d-804b-4460-90a8-f9920843651b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:11.532797 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a6b0837d-804b-4460-90a8-f9920843651b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:11.537351 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ecc96953-aa6b-4f4b-88eb-ada0da5c4009 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:11.542483 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ecc96953-aa6b-4f4b-88eb-ada0da5c4009 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:11.557485 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ecc96953-aa6b-4f4b-88eb-ada0da5c4009 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:11.558005 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ecc96953-aa6b-4f4b-88eb-ada0da5c4009 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:11.558956 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ecc96953-aa6b-4f4b-88eb-ada0da5c4009 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:11.559472 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ecc96953-aa6b-4f4b-88eb-ada0da5c4009 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:11.773863 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a6b0837d-804b-4460-90a8-f9920843651b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:11.785221 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a6b0837d-804b-4460-90a8-f9920843651b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1711 microversion: 2.1 time: 0.268492 Jul 24 01:15:11.796297 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 229/476] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:11 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1711 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:15:11.815921 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ecc96953-aa6b-4f4b-88eb-ada0da5c4009 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:11.824291 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ecc96953-aa6b-4f4b-88eb-ada0da5c4009 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.290961 Jul 24 01:15:11.825083 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 248/477] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:11 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:12.805756 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8f78e026-97fc-4b76-869e-d64eb7fa7e5b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:12.806509 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8f78e026-97fc-4b76-869e-d64eb7fa7e5b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:12.814481 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8f78e026-97fc-4b76-869e-d64eb7fa7e5b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.815418 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8f78e026-97fc-4b76-869e-d64eb7fa7e5b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:12.816969 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8f78e026-97fc-4b76-869e-d64eb7fa7e5b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.817604 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8f78e026-97fc-4b76-869e-d64eb7fa7e5b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:12.841891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-acfb58ca-09bd-4f19-b224-bad7fd3467ac tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:12.842548 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-acfb58ca-09bd-4f19-b224-bad7fd3467ac tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:12.849835 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acfb58ca-09bd-4f19-b224-bad7fd3467ac tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.850572 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acfb58ca-09bd-4f19-b224-bad7fd3467ac tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:12.851561 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acfb58ca-09bd-4f19-b224-bad7fd3467ac tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.852228 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-acfb58ca-09bd-4f19-b224-bad7fd3467ac tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:13.025947 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8f78e026-97fc-4b76-869e-d64eb7fa7e5b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:13.035127 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8f78e026-97fc-4b76-869e-d64eb7fa7e5b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1711 microversion: 2.1 time: 0.234448 Jul 24 01:15:13.046528 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 230/478] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:12 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1711 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:13.090788 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-acfb58ca-09bd-4f19-b224-bad7fd3467ac tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:13.098347 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-acfb58ca-09bd-4f19-b224-bad7fd3467ac tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1366 microversion: 2.1 time: 0.260533 Jul 24 01:15:13.098914 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 249/479] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:12 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:15:14.056108 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e3e3b395-3819-471c-a532-1d3ef168d4cc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:14.057598 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e3e3b395-3819-471c-a532-1d3ef168d4cc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:14.069064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e3e3b395-3819-471c-a532-1d3ef168d4cc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.069819 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e3e3b395-3819-471c-a532-1d3ef168d4cc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.071592 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e3e3b395-3819-471c-a532-1d3ef168d4cc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.072350 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e3e3b395-3819-471c-a532-1d3ef168d4cc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.116574 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5c45fd61-f5dd-45aa-a8bb-08cbe9eb1798 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:14.118072 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-5c45fd61-f5dd-45aa-a8bb-08cbe9eb1798 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:14.130922 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5c45fd61-f5dd-45aa-a8bb-08cbe9eb1798 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.140279 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5c45fd61-f5dd-45aa-a8bb-08cbe9eb1798 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.141568 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5c45fd61-f5dd-45aa-a8bb-08cbe9eb1798 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.142344 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5c45fd61-f5dd-45aa-a8bb-08cbe9eb1798 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.373149 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-5c45fd61-f5dd-45aa-a8bb-08cbe9eb1798 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:14.379786 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e3e3b395-3819-471c-a532-1d3ef168d4cc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:14.381290 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5c45fd61-f5dd-45aa-a8bb-08cbe9eb1798 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1556 microversion: 2.1 time: 0.269696 Jul 24 01:15:14.381868 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 250/480] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:14 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1556 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:14.390827 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e3e3b395-3819-471c-a532-1d3ef168d4cc tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1711 microversion: 2.1 time: 0.340028 Jul 24 01:15:14.398364 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f6c5087f-414f-4057-97e1-c521ba1ffe21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:14.399128 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f6c5087f-414f-4057-97e1-c521ba1ffe21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:14.409197 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6c5087f-414f-4057-97e1-c521ba1ffe21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.410022 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6c5087f-414f-4057-97e1-c521ba1ffe21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.411651 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6c5087f-414f-4057-97e1-c521ba1ffe21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.412435 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6c5087f-414f-4057-97e1-c521ba1ffe21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.420294 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 231/481] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:14 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1711 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:14.543211 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f6c5087f-414f-4057-97e1-c521ba1ffe21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148742 Jul 24 01:15:14.543833 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 251/482] 10.222.0.42 () {58 vars in 1274 bytes} [Sun Jul 24 01:15:14 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:14.770079 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-fabe5292-be85-40c5-b17c-decb0233f84b req-6e2244d2-76c0-4764-a8ea-a68219534982 admin admin] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:14.777871 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [req-fabe5292-be85-40c5-b17c-decb0233f84b req-6e2244d2-76c0-4764-a8ea-a68219534982 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0485860-44f6-4783-97a7-f4dbef82a919(cell1) {{(pid=118036) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 24 01:15:14.778737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-fabe5292-be85-40c5-b17c-decb0233f84b req-6e2244d2-76c0-4764-a8ea-a68219534982 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.779379 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-fabe5292-be85-40c5-b17c-decb0233f84b req-6e2244d2-76c0-4764-a8ea-a68219534982 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.825219 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-fabe5292-be85-40c5-b17c-decb0233f84b req-6e2244d2-76c0-4764-a8ea-a68219534982 admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.825933 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-fabe5292-be85-40c5-b17c-decb0233f84b req-6e2244d2-76c0-4764-a8ea-a68219534982 admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.850909 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-fabe5292-be85-40c5-b17c-decb0233f84b req-6e2244d2-76c0-4764-a8ea-a68219534982 admin admin] 10.222.0.20 "DELETE /compute/v2.1/os-assisted-volume-snapshots/acbd9a34-c0dc-40fd-8f41-59a156452330?delete_info=%7B%22file_to_merge%22:%20%22volume-8d9eaad3-3c4f-4e98-b6c9-284f08f99292.acbd9a34-c0dc-40fd-8f41-59a156452330.vhdx%22,%20%22volume_id%22:%20%228d9eaad3-3c4f-4e98-b6c9-284f08f99292%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.156598 Jul 24 01:15:14.851683 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 232/483] 10.222.0.20 () {62 vars in 1800 bytes} [Sun Jul 24 01:15:14 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/acbd9a34-c0dc-40fd-8f41-59a156452330?delete_info=%7B%22file_to_merge%22:%20%22volume-8d9eaad3-3c4f-4e98-b6c9-284f08f99292.acbd9a34-c0dc-40fd-8f41-59a156452330.vhdx%22,%20%22volume_id%22:%20%228d9eaad3-3c4f-4e98-b6c9-284f08f99292%22%7D => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:15:15.410732 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e71d4c84-6041-4496-afe3-e33641e0e1f9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:15.411446 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e71d4c84-6041-4496-afe3-e33641e0e1f9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:15.420893 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e71d4c84-6041-4496-afe3-e33641e0e1f9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:15.421635 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e71d4c84-6041-4496-afe3-e33641e0e1f9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:15.422703 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e71d4c84-6041-4496-afe3-e33641e0e1f9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:15.423323 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e71d4c84-6041-4496-afe3-e33641e0e1f9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:15.724380 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e71d4c84-6041-4496-afe3-e33641e0e1f9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:15.738992 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e71d4c84-6041-4496-afe3-e33641e0e1f9 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1715 microversion: 2.1 time: 0.334180 Jul 24 01:15:15.754535 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 252/484] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:15 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1715 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:16.048643 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-94a568a4-e571-48ea-8550-99603dd62cf5 req-77237561-dd58-44bb-912b-f92c18271b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74d4adf-6c79-421f-b475-3eb478eb2124", "tag": "0cc7ea74-2a38-44cd-bfab-54da31684bd5"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:16.058244 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-94a568a4-e571-48ea-8550-99603dd62cf5 req-77237561-dd58-44bb-912b-f92c18271b7d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:16.058714 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-94a568a4-e571-48ea-8550-99603dd62cf5 req-77237561-dd58-44bb-912b-f92c18271b7d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:16.072823 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-94a568a4-e571-48ea-8550-99603dd62cf5 req-77237561-dd58-44bb-912b-f92c18271b7d service nova] Creating event network-changed:0cc7ea74-2a38-44cd-bfab-54da31684bd5 for instance c74d4adf-6c79-421f-b475-3eb478eb2124 on hv-cinder-maste Jul 24 01:15:16.081826 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-94a568a4-e571-48ea-8550-99603dd62cf5 req-77237561-dd58-44bb-912b-f92c18271b7d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037909 Jul 24 01:15:16.082914 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 233/485] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:20.245484 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=8 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:20.298611 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-8a95bd33-028a-44da-b91f-d45918dc7a51 req-6c406a74-ea65-449e-9c7b-ab0934036bea admin admin] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:20.301102 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-8a95bd33-028a-44da-b91f-d45918dc7a51 req-6c406a74-ea65-449e-9c7b-ab0934036bea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:20.301541 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-8a95bd33-028a-44da-b91f-d45918dc7a51 req-6c406a74-ea65-449e-9c7b-ab0934036bea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:20.309983 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-8a95bd33-028a-44da-b91f-d45918dc7a51 req-6c406a74-ea65-449e-9c7b-ab0934036bea admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:20.310425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-8a95bd33-028a-44da-b91f-d45918dc7a51 req-6c406a74-ea65-449e-9c7b-ab0934036bea admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:20.324800 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-8a95bd33-028a-44da-b91f-d45918dc7a51 req-6c406a74-ea65-449e-9c7b-ab0934036bea admin admin] 10.222.0.20 "DELETE /compute/v2.1/os-assisted-volume-snapshots/ce4beb3c-03b5-45e9-9bf1-6a42857904c4?delete_info=%7B%22file_to_merge%22:%20%22volume-8d9eaad3-3c4f-4e98-b6c9-284f08f99292.ce4beb3c-03b5-45e9-9bf1-6a42857904c4.vhdx%22,%20%22volume_id%22:%20%228d9eaad3-3c4f-4e98-b6c9-284f08f99292%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.087280 Jul 24 01:15:20.325939 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 253/486] 10.222.0.20 () {62 vars in 1800 bytes} [Sun Jul 24 01:15:20 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/ce4beb3c-03b5-45e9-9bf1-6a42857904c4?delete_info=%7B%22file_to_merge%22:%20%22volume-8d9eaad3-3c4f-4e98-b6c9-284f08f99292.ce4beb3c-03b5-45e9-9bf1-6a42857904c4.vhdx%22,%20%22volume_id%22:%20%228d9eaad3-3c4f-4e98-b6c9-284f08f99292%22%7D => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:15:24.338519 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-d8b02b7a-5013-4cfa-b1c6-12a4f36ebe62 req-50bf8a7e-7298-41c2-b8c1-0f65b31a18ab admin admin] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:24.340549 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-d8b02b7a-5013-4cfa-b1c6-12a4f36ebe62 req-50bf8a7e-7298-41c2-b8c1-0f65b31a18ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:24.340989 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-d8b02b7a-5013-4cfa-b1c6-12a4f36ebe62 req-50bf8a7e-7298-41c2-b8c1-0f65b31a18ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:24.349147 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-d8b02b7a-5013-4cfa-b1c6-12a4f36ebe62 req-50bf8a7e-7298-41c2-b8c1-0f65b31a18ab admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:24.349593 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-d8b02b7a-5013-4cfa-b1c6-12a4f36ebe62 req-50bf8a7e-7298-41c2-b8c1-0f65b31a18ab admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:24.362418 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-d8b02b7a-5013-4cfa-b1c6-12a4f36ebe62 req-50bf8a7e-7298-41c2-b8c1-0f65b31a18ab admin admin] 10.222.0.20 "DELETE /compute/v2.1/os-assisted-volume-snapshots/4b160ade-dd37-4392-8949-c7e8e126f114?delete_info=%7B%22file_to_merge%22:%20%22volume-8d9eaad3-3c4f-4e98-b6c9-284f08f99292.4b160ade-dd37-4392-8949-c7e8e126f114.vhdx%22,%20%22volume_id%22:%20%228d9eaad3-3c4f-4e98-b6c9-284f08f99292%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.135518 Jul 24 01:15:24.363189 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 234/487] 10.222.0.20 () {62 vars in 1800 bytes} [Sun Jul 24 01:15:24 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/4b160ade-dd37-4392-8949-c7e8e126f114?delete_info=%7B%22file_to_merge%22:%20%22volume-8d9eaad3-3c4f-4e98-b6c9-284f08f99292.4b160ade-dd37-4392-8949-c7e8e126f114.vhdx%22,%20%22volume_id%22:%20%228d9eaad3-3c4f-4e98-b6c9-284f08f99292%22%7D => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:15:28.205843 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=47 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:28.210566 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-038cf26f-6894-4580-b186-b6b5fd07cd33 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:28.211159 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-038cf26f-6894-4580-b186-b6b5fd07cd33 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:28.217991 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-038cf26f-6894-4580-b186-b6b5fd07cd33 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:28.218432 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-038cf26f-6894-4580-b186-b6b5fd07cd33 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:28.219187 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-038cf26f-6894-4580-b186-b6b5fd07cd33 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:28.219656 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-038cf26f-6894-4580-b186-b6b5fd07cd33 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:28.347773 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-038cf26f-6894-4580-b186-b6b5fd07cd33 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lazy-loading 'services' on Instance uuid 8fe323e1-5672-4861-86f6-9ad130ae8559 {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:28.478520 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-038cf26f-6894-4580-b186-b6b5fd07cd33 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559/os-volume_attachments/8d9eaad3-3c4f-4e98-b6c9-284f08f99292" status: 202 len: 0 microversion: 2.1 time: 0.273610 Jul 24 01:15:28.479157 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 254/488] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:15:28 2022] DELETE /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559/os-volume_attachments/8d9eaad3-3c4f-4e98-b6c9-284f08f99292 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:15:29.618553 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=25 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:29.623464 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3b468807-9dde-4162-aa5a-f0fac922ab32 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:29.624046 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3b468807-9dde-4162-aa5a-f0fac922ab32 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:29.630837 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3b468807-9dde-4162-aa5a-f0fac922ab32 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.631286 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3b468807-9dde-4162-aa5a-f0fac922ab32 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.632067 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3b468807-9dde-4162-aa5a-f0fac922ab32 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.633729 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3b468807-9dde-4162-aa5a-f0fac922ab32 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.664112 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3b468807-9dde-4162-aa5a-f0fac922ab32 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Going to try to terminate instance {{(pid=118036) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:15:29.754544 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3b468807-9dde-4162-aa5a-f0fac922ab32 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 204 len: 0 microversion: 2.1 time: 0.137796 Jul 24 01:15:29.755433 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 235/489] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:15:29 2022] DELETE /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:15:29.766553 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-29e3e5b9-ea76-4ed8-a6ba-f6855810ad36 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:29.767263 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-29e3e5b9-ea76-4ed8-a6ba-f6855810ad36 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:29.777891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-29e3e5b9-ea76-4ed8-a6ba-f6855810ad36 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.777891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-29e3e5b9-ea76-4ed8-a6ba-f6855810ad36 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.777891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-29e3e5b9-ea76-4ed8-a6ba-f6855810ad36 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.777891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-29e3e5b9-ea76-4ed8-a6ba-f6855810ad36 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.920105 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-29e3e5b9-ea76-4ed8-a6ba-f6855810ad36 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:29.928397 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-29e3e5b9-ea76-4ed8-a6ba-f6855810ad36 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1513 microversion: 2.1 time: 0.167586 Jul 24 01:15:29.928961 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 255/490] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:29 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:30.947052 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8ce06073-0836-4ff8-a562-c09d8165f627 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:30.947842 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8ce06073-0836-4ff8-a562-c09d8165f627 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:30.955132 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8ce06073-0836-4ff8-a562-c09d8165f627 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:30.955649 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8ce06073-0836-4ff8-a562-c09d8165f627 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:30.956447 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8ce06073-0836-4ff8-a562-c09d8165f627 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:30.956982 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8ce06073-0836-4ff8-a562-c09d8165f627 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:30.977597 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:31.092360 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8ce06073-0836-4ff8-a562-c09d8165f627 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:31.100120 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8ce06073-0836-4ff8-a562-c09d8165f627 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1513 microversion: 2.1 time: 0.157660 Jul 24 01:15:31.100663 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 236/491] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:30 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:32.116879 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3a8bb2e3-fece-45a1-b11f-db1bfd7bc459 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:32.117454 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3a8bb2e3-fece-45a1-b11f-db1bfd7bc459 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:32.119626 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:32.130651 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3a8bb2e3-fece-45a1-b11f-db1bfd7bc459 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:32.131395 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3a8bb2e3-fece-45a1-b11f-db1bfd7bc459 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:32.133204 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3a8bb2e3-fece-45a1-b11f-db1bfd7bc459 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:32.138026 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3a8bb2e3-fece-45a1-b11f-db1bfd7bc459 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:32.268372 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3a8bb2e3-fece-45a1-b11f-db1bfd7bc459 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:32.276313 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3a8bb2e3-fece-45a1-b11f-db1bfd7bc459 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1513 microversion: 2.1 time: 0.163391 Jul 24 01:15:32.276882 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 256/492] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:32 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:33.293767 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d2219ffd-0ce5-4f25-9933-edbe1c5eae42 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:33.294441 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d2219ffd-0ce5-4f25-9933-edbe1c5eae42 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:33.301696 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d2219ffd-0ce5-4f25-9933-edbe1c5eae42 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:33.302150 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d2219ffd-0ce5-4f25-9933-edbe1c5eae42 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:33.302923 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d2219ffd-0ce5-4f25-9933-edbe1c5eae42 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:33.303388 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d2219ffd-0ce5-4f25-9933-edbe1c5eae42 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:33.438102 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d2219ffd-0ce5-4f25-9933-edbe1c5eae42 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:33.446276 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d2219ffd-0ce5-4f25-9933-edbe1c5eae42 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1513 microversion: 2.1 time: 0.156613 Jul 24 01:15:33.446877 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 237/493] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:33 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:34.464574 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1a9f3c49-b963-478a-855f-8f2ea357fbda tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:34.465335 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1a9f3c49-b963-478a-855f-8f2ea357fbda tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:34.472408 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1a9f3c49-b963-478a-855f-8f2ea357fbda tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:34.472929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1a9f3c49-b963-478a-855f-8f2ea357fbda tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:34.473770 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1a9f3c49-b963-478a-855f-8f2ea357fbda tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:34.474286 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1a9f3c49-b963-478a-855f-8f2ea357fbda tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:34.606602 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1a9f3c49-b963-478a-855f-8f2ea357fbda tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:34.614213 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1a9f3c49-b963-478a-855f-8f2ea357fbda tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1513 microversion: 2.1 time: 0.154265 Jul 24 01:15:34.614781 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 257/494] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:34 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:35.634681 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7e393306-7e42-445a-abc8-1e41d34fe998 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:35.635735 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7e393306-7e42-445a-abc8-1e41d34fe998 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:35.639643 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=4 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:35.648459 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7e393306-7e42-445a-abc8-1e41d34fe998 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:35.648952 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7e393306-7e42-445a-abc8-1e41d34fe998 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:35.649796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7e393306-7e42-445a-abc8-1e41d34fe998 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:35.650310 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7e393306-7e42-445a-abc8-1e41d34fe998 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:35.790650 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7e393306-7e42-445a-abc8-1e41d34fe998 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:35.798278 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7e393306-7e42-445a-abc8-1e41d34fe998 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1513 microversion: 2.1 time: 0.170032 Jul 24 01:15:35.808114 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 238/495] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:35 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:36.247477 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-4bec4090-054f-429c-96b7-c874c8397cb3 req-f4968799-ccbf-4f45-a79a-eb37142d5017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe323e1-5672-4861-86f6-9ad130ae8559", "name": "network-vif-deleted", "tag": "6df8987c-6158-4efb-8f70-f70a423a7935"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:36.262431 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-4bec4090-054f-429c-96b7-c874c8397cb3 req-f4968799-ccbf-4f45-a79a-eb37142d5017 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.263120 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-4bec4090-054f-429c-96b7-c874c8397cb3 req-f4968799-ccbf-4f45-a79a-eb37142d5017 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.275973 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-4bec4090-054f-429c-96b7-c874c8397cb3 req-f4968799-ccbf-4f45-a79a-eb37142d5017 service nova] Creating event network-vif-deleted:6df8987c-6158-4efb-8f70-f70a423a7935 for instance 8fe323e1-5672-4861-86f6-9ad130ae8559 on hv-cinder-maste Jul 24 01:15:36.280923 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-4bec4090-054f-429c-96b7-c874c8397cb3 req-f4968799-ccbf-4f45-a79a-eb37142d5017 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039706 Jul 24 01:15:36.281565 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 258/496] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:36.820109 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:36.820641 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:36.827749 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.828226 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.828998 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.829438 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.862775 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.863221 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.863692 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lazy-loading 'fault' on Instance uuid 8fe323e1-5672-4861-86f6-9ad130ae8559 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:36.907072 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:36.914934 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-beca7e69-7ec9-44d6-809a-dce98952738e tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 200 len: 1308 microversion: 2.1 time: 0.099779 Jul 24 01:15:36.916566 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 239/497] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:36 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:37.934711 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:37.935333 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 8fe323e1-5672-4861-86f6-9ad130ae8559] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:37.942255 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:37.942706 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:37.943496 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:37.943926 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:37.957459 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] HTTP exception thrown: Instance 8fe323e1-5672-4861-86f6-9ad130ae8559 could not be found. Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Request method failure captured: Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 HTTP/1.1 Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JzLpnkH3Pf6NYd0yPTegcZBM2TLG-8nHul6RVKqdYcHiRgLt1kppLIsLXaHehU87DwhReKvhcz_SVMqyqJE8y6kyGTrluresMVpsmYCnINDS1d8oOqtltIrnPQaevfWuv2RJ865Kn2VKHpBxkY1Hp4pVg5WtcD3pQhzxe9YrEmwwuQ Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: f939fe11bf294c2e92ed1f8e9c5d43e2 Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1757858 Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:15:37.959049 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f939fe11bf294c2e92ed1f8e9c5d43e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f939fe11bf294c2e92ed1f8e9c5d43e2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f939fe11bf294c2e92ed1f8e9c5d43e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f939fe11bf294c2e92ed1f8e9c5d43e2"}]}] Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-VolumesSnapshotTestJSON-1757858 Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: f939fe11bf294c2e92ed1f8e9c5d43e2 Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1757858 Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-VolumesSnapshotTestJSON-1757858-project Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: b6e93b46abca4638a2c5ca6615c8972a Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-VolumesSnapshotTestJSON-1757858-project Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 8fe323e1-5672-4861-86f6-9ad130ae8559 could not be found. Jul 24 01:15:37.960582 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '8fe323e1-5672-4861-86f6-9ad130ae8559'} Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe323e1-5672-4861-86f6-9ad130ae8559 could not be found. Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:15:37.961445 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe323e1-5672-4861-86f6-9ad130ae8559 could not be found. Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe323e1-5672-4861-86f6-9ad130ae8559 could not be found. Jul 24 01:15:37.962726 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:15:37.963864 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Returning 404 to user: Instance 8fe323e1-5672-4861-86f6-9ad130ae8559 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:15:37.963864 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c00a6134-0712-4c5c-a458-6166acc54e44 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559" status: 404 len: 111 microversion: 2.1 time: 0.030995 Jul 24 01:15:37.963864 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 259/498] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:37 2022] GET /compute/v2.1/servers/8fe323e1-5672-4861-86f6-9ad130ae8559 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:15:39.677559 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1acbed5f-5a62-4981-aa7b-58496053706f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:39.678564 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1acbed5f-5a62-4981-aa7b-58496053706f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:39.685616 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1acbed5f-5a62-4981-aa7b-58496053706f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:39.686070 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1acbed5f-5a62-4981-aa7b-58496053706f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:39.686860 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1acbed5f-5a62-4981-aa7b-58496053706f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:39.687309 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1acbed5f-5a62-4981-aa7b-58496053706f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:39.763344 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1acbed5f-5a62-4981-aa7b-58496053706f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "POST /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/action" status: 202 len: 0 microversion: 2.1 time: 0.089908 Jul 24 01:15:39.766891 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 240/499] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:15:39 2022] POST /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:15:39.772273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ff8ffe3d-7de3-4c2c-8fa4-250263bf4775 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:39.772871 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ff8ffe3d-7de3-4c2c-8fa4-250263bf4775 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:39.779768 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ff8ffe3d-7de3-4c2c-8fa4-250263bf4775 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:39.780215 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ff8ffe3d-7de3-4c2c-8fa4-250263bf4775 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:39.780954 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ff8ffe3d-7de3-4c2c-8fa4-250263bf4775 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:39.781388 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ff8ffe3d-7de3-4c2c-8fa4-250263bf4775 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:39.784078 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:39.940675 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ff8ffe3d-7de3-4c2c-8fa4-250263bf4775 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:39.949147 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ff8ffe3d-7de3-4c2c-8fa4-250263bf4775 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1751 microversion: 2.1 time: 0.180877 Jul 24 01:15:39.949995 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 260/500] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:39 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:40.971156 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-511a7225-4498-4664-a2bf-5f3d348a63a6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:40.971889 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-511a7225-4498-4664-a2bf-5f3d348a63a6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:40.978801 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-511a7225-4498-4664-a2bf-5f3d348a63a6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.979256 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-511a7225-4498-4664-a2bf-5f3d348a63a6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.981161 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-511a7225-4498-4664-a2bf-5f3d348a63a6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.981161 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-511a7225-4498-4664-a2bf-5f3d348a63a6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:41.134329 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-511a7225-4498-4664-a2bf-5f3d348a63a6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:41.142827 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-511a7225-4498-4664-a2bf-5f3d348a63a6 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1751 microversion: 2.1 time: 0.176986 Jul 24 01:15:41.143407 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 241/501] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:40 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:41.737947 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-583476803", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "networks": [{"uuid": "469c843f-e4a2-42fa-a196-84a5267ce3c8"}]}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:41.790262 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.network.neutron [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] validate_networks() for [('469c843f-e4a2-42fa-a196-84a5267ce3c8', None, None, None, None, None)] {{(pid=118035) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:15:42.134723 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Flavor limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:15:42.135144 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Image limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:15:42.135665 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Flavor pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:15:42.136061 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Image pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:15:42.136464 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:15:42.145860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.146303 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.147085 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.147584 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.160230 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e4cc3053-2eb5-4c34-8f45-cc606d13adc2 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:42.161017 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e4cc3053-2eb5-4c34-8f45-cc606d13adc2 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:42.164718 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Getting quotas for project f939fe11bf294c2e92ed1f8e9c5d43e2. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:15:42.168219 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e4cc3053-2eb5-4c34-8f45-cc606d13adc2 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.168751 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e4cc3053-2eb5-4c34-8f45-cc606d13adc2 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.168890 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Getting quotas for user b6e93b46abca4638a2c5ca6615c8972a and project f939fe11bf294c2e92ed1f8e9c5d43e2. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:15:42.169643 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e4cc3053-2eb5-4c34-8f45-cc606d13adc2 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.170150 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e4cc3053-2eb5-4c34-8f45-cc606d13adc2 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.180333 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Going to run 1 instances... {{(pid=118035) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:15:42.182641 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118035) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:15:42.227172 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-246e1cbd-8fb3-42cc-bd0a-c3033bce371a tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493077 Jul 24 01:15:42.232732 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 261/502] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:15:42.237711 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-089e5cb8-2d19-48ec-be5e-54bef3f86ffb tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:42.238316 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-089e5cb8-2d19-48ec-be5e-54bef3f86ffb tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:42.308477 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-089e5cb8-2d19-48ec-be5e-54bef3f86ffb tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:42.317573 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-089e5cb8-2d19-48ec-be5e-54bef3f86ffb tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1218 microversion: 2.1 time: 0.083490 Jul 24 01:15:42.318383 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 262/503] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:42 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:15:42.348470 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e4cc3053-2eb5-4c34-8f45-cc606d13adc2 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:42.356791 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e4cc3053-2eb5-4c34-8f45-cc606d13adc2 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.200179 Jul 24 01:15:42.357769 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 242/504] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:42 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:43.334369 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-53c60efc-a495-4807-ad92-15679f4f96e4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:43.335031 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-53c60efc-a495-4807-ad92-15679f4f96e4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:43.341892 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53c60efc-a495-4807-ad92-15679f4f96e4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.342344 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53c60efc-a495-4807-ad92-15679f4f96e4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.343105 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53c60efc-a495-4807-ad92-15679f4f96e4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.343606 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53c60efc-a495-4807-ad92-15679f4f96e4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.374124 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4052dba6-c1e7-49b6-a70e-a4b4119af47a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:43.375146 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4052dba6-c1e7-49b6-a70e-a4b4119af47a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:43.382914 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4052dba6-c1e7-49b6-a70e-a4b4119af47a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.383754 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4052dba6-c1e7-49b6-a70e-a4b4119af47a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.384778 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4052dba6-c1e7-49b6-a70e-a4b4119af47a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.385269 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4052dba6-c1e7-49b6-a70e-a4b4119af47a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.410991 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-53c60efc-a495-4807-ad92-15679f4f96e4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:43.422289 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-53c60efc-a495-4807-ad92-15679f4f96e4 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1278 microversion: 2.1 time: 0.091812 Jul 24 01:15:43.423775 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 263/505] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:43 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:43.552193 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4052dba6-c1e7-49b6-a70e-a4b4119af47a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:43.560820 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4052dba6-c1e7-49b6-a70e-a4b4119af47a tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.190921 Jul 24 01:15:43.570240 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 243/506] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:43 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:44.442696 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1cd7e376-d7b2-4773-82ad-412fa3a95787 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:44.443347 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1cd7e376-d7b2-4773-82ad-412fa3a95787 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:44.453182 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1cd7e376-d7b2-4773-82ad-412fa3a95787 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:44.453725 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1cd7e376-d7b2-4773-82ad-412fa3a95787 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:44.454838 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1cd7e376-d7b2-4773-82ad-412fa3a95787 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:44.455387 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1cd7e376-d7b2-4773-82ad-412fa3a95787 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:44.579892 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-49c5d585-0b50-4dce-85d5-5ff900944801 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:44.580836 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-49c5d585-0b50-4dce-85d5-5ff900944801 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:44.588346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-49c5d585-0b50-4dce-85d5-5ff900944801 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:44.588790 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-49c5d585-0b50-4dce-85d5-5ff900944801 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:44.589555 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-49c5d585-0b50-4dce-85d5-5ff900944801 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:44.589985 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-49c5d585-0b50-4dce-85d5-5ff900944801 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:44.593798 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1cd7e376-d7b2-4773-82ad-412fa3a95787 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:44.601585 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1cd7e376-d7b2-4773-82ad-412fa3a95787 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1318 microversion: 2.1 time: 0.164746 Jul 24 01:15:44.602461 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 264/507] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:44 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:44.735674 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-49c5d585-0b50-4dce-85d5-5ff900944801 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:44.744637 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-49c5d585-0b50-4dce-85d5-5ff900944801 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.170489 Jul 24 01:15:44.747332 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 244/508] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:44 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:44.783180 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-18e3d4c4-38c1-4d83-b2c6-b24f1af783c3 req-fc96525b-d559-4d5c-a9e8-895e4b643b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2327f8ed-4fda-414b-a418-6dec644392d1", "tag": "98d0d35b-addc-4c7c-9d5e-e20031cea0cf"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:44.807284 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-18e3d4c4-38c1-4d83-b2c6-b24f1af783c3 req-fc96525b-d559-4d5c-a9e8-895e4b643b04 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:44.807760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-18e3d4c4-38c1-4d83-b2c6-b24f1af783c3 req-fc96525b-d559-4d5c-a9e8-895e4b643b04 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:44.818649 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-18e3d4c4-38c1-4d83-b2c6-b24f1af783c3 req-fc96525b-d559-4d5c-a9e8-895e4b643b04 service nova] Creating event network-changed:98d0d35b-addc-4c7c-9d5e-e20031cea0cf for instance 2327f8ed-4fda-414b-a418-6dec644392d1 on hv-cinder-maste Jul 24 01:15:44.824549 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-18e3d4c4-38c1-4d83-b2c6-b24f1af783c3 req-fc96525b-d559-4d5c-a9e8-895e4b643b04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045418 Jul 24 01:15:44.825149 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 265/509] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:15:45.622402 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-faf2c9bb-7a39-4dbf-bb96-061da787460d tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:45.623229 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-faf2c9bb-7a39-4dbf-bb96-061da787460d tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:45.632809 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-faf2c9bb-7a39-4dbf-bb96-061da787460d tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.633333 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-faf2c9bb-7a39-4dbf-bb96-061da787460d tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.634063 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-faf2c9bb-7a39-4dbf-bb96-061da787460d tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.634731 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-faf2c9bb-7a39-4dbf-bb96-061da787460d tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.763108 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-58ba2923-06f9-437f-984e-6cad1d21afcd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:45.763814 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-58ba2923-06f9-437f-984e-6cad1d21afcd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:45.770437 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-58ba2923-06f9-437f-984e-6cad1d21afcd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.770876 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-58ba2923-06f9-437f-984e-6cad1d21afcd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.771667 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-58ba2923-06f9-437f-984e-6cad1d21afcd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.772091 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-58ba2923-06f9-437f-984e-6cad1d21afcd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.777262 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-faf2c9bb-7a39-4dbf-bb96-061da787460d tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:45.785332 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-faf2c9bb-7a39-4dbf-bb96-061da787460d tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1318 microversion: 2.1 time: 0.168541 Jul 24 01:15:45.785901 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 245/510] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:45 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:45.918643 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-58ba2923-06f9-437f-984e-6cad1d21afcd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:45.930514 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-58ba2923-06f9-437f-984e-6cad1d21afcd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.172143 Jul 24 01:15:45.931066 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 266/511] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:45 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:46.804753 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-41b9a322-fff9-4ce8-a2ce-42fd1e8c7c78 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:46.805370 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-41b9a322-fff9-4ce8-a2ce-42fd1e8c7c78 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:46.812950 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-41b9a322-fff9-4ce8-a2ce-42fd1e8c7c78 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.813424 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-41b9a322-fff9-4ce8-a2ce-42fd1e8c7c78 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.814188 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-41b9a322-fff9-4ce8-a2ce-42fd1e8c7c78 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.814629 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-41b9a322-fff9-4ce8-a2ce-42fd1e8c7c78 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.947815 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c8d6c931-f105-4d44-926b-6ef8e3f80e58 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:46.948391 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c8d6c931-f105-4d44-926b-6ef8e3f80e58 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:46.955253 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8d6c931-f105-4d44-926b-6ef8e3f80e58 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.955690 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8d6c931-f105-4d44-926b-6ef8e3f80e58 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.956487 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8d6c931-f105-4d44-926b-6ef8e3f80e58 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.956889 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8d6c931-f105-4d44-926b-6ef8e3f80e58 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.961833 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-41b9a322-fff9-4ce8-a2ce-42fd1e8c7c78 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:46.969592 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-41b9a322-fff9-4ce8-a2ce-42fd1e8c7c78 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1318 microversion: 2.1 time: 0.170612 Jul 24 01:15:46.970156 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 246/512] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:46 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:47.098133 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c8d6c931-f105-4d44-926b-6ef8e3f80e58 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:47.106195 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c8d6c931-f105-4d44-926b-6ef8e3f80e58 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.162323 Jul 24 01:15:47.106761 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 267/513] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:46 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:47.991330 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d4ad1bd4-700a-4a3a-a71f-d40b77f1e2f1 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:47.992194 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d4ad1bd4-700a-4a3a-a71f-d40b77f1e2f1 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:47.999250 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d4ad1bd4-700a-4a3a-a71f-d40b77f1e2f1 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:47.999723 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d4ad1bd4-700a-4a3a-a71f-d40b77f1e2f1 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:48.000469 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d4ad1bd4-700a-4a3a-a71f-d40b77f1e2f1 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:48.000894 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d4ad1bd4-700a-4a3a-a71f-d40b77f1e2f1 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:48.123688 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-26ea8b6b-957a-4f7c-befd-a006cdaa751c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:48.124306 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-26ea8b6b-957a-4f7c-befd-a006cdaa751c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:48.131022 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-26ea8b6b-957a-4f7c-befd-a006cdaa751c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:48.131510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-26ea8b6b-957a-4f7c-befd-a006cdaa751c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:48.132248 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-26ea8b6b-957a-4f7c-befd-a006cdaa751c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:48.133063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-26ea8b6b-957a-4f7c-befd-a006cdaa751c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:48.135230 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d4ad1bd4-700a-4a3a-a71f-d40b77f1e2f1 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:48.143384 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d4ad1bd4-700a-4a3a-a71f-d40b77f1e2f1 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1318 microversion: 2.1 time: 0.158447 Jul 24 01:15:48.144163 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 247/514] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:47 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:48.277314 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-26ea8b6b-957a-4f7c-befd-a006cdaa751c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:48.285399 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-26ea8b6b-957a-4f7c-befd-a006cdaa751c tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.165594 Jul 24 01:15:48.286002 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 268/515] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:48 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:49.165158 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-cbbe91ff-a7f0-443a-99b7-b481b7d3dade tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:49.165975 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-cbbe91ff-a7f0-443a-99b7-b481b7d3dade tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:49.177332 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cbbe91ff-a7f0-443a-99b7-b481b7d3dade tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.178098 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cbbe91ff-a7f0-443a-99b7-b481b7d3dade tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.179352 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cbbe91ff-a7f0-443a-99b7-b481b7d3dade tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.180249 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cbbe91ff-a7f0-443a-99b7-b481b7d3dade tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.302805 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8e89842e-6353-4f62-99d6-82ab5f0e4cd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:49.303510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8e89842e-6353-4f62-99d6-82ab5f0e4cd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:49.308216 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cbbe91ff-a7f0-443a-99b7-b481b7d3dade tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:49.310515 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e89842e-6353-4f62-99d6-82ab5f0e4cd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.310988 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e89842e-6353-4f62-99d6-82ab5f0e4cd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.311782 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e89842e-6353-4f62-99d6-82ab5f0e4cd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.312210 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8e89842e-6353-4f62-99d6-82ab5f0e4cd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.315617 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-cbbe91ff-a7f0-443a-99b7-b481b7d3dade tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1318 microversion: 2.1 time: 0.157297 Jul 24 01:15:49.316207 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 248/516] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:49 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:49.462279 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8e89842e-6353-4f62-99d6-82ab5f0e4cd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:49.470721 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8e89842e-6353-4f62-99d6-82ab5f0e4cd4 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.172348 Jul 24 01:15:49.471266 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 269/517] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:49 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:50.336291 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1d05afd0-4eac-4233-a713-0f3538e642c2 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:50.337240 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1d05afd0-4eac-4233-a713-0f3538e642c2 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:50.348243 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1d05afd0-4eac-4233-a713-0f3538e642c2 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.348980 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1d05afd0-4eac-4233-a713-0f3538e642c2 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.350228 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1d05afd0-4eac-4233-a713-0f3538e642c2 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.350938 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1d05afd0-4eac-4233-a713-0f3538e642c2 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.482387 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1d05afd0-4eac-4233-a713-0f3538e642c2 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:50.488727 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-743f584c-8bf2-4a04-9610-c3119bf42518 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:50.489368 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-743f584c-8bf2-4a04-9610-c3119bf42518 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:50.490512 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1d05afd0-4eac-4233-a713-0f3538e642c2 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1318 microversion: 2.1 time: 0.160719 Jul 24 01:15:50.491112 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 249/518] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:50 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:50.495950 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-743f584c-8bf2-4a04-9610-c3119bf42518 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.496403 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-743f584c-8bf2-4a04-9610-c3119bf42518 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.497163 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-743f584c-8bf2-4a04-9610-c3119bf42518 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.497593 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-743f584c-8bf2-4a04-9610-c3119bf42518 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.645157 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-743f584c-8bf2-4a04-9610-c3119bf42518 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:50.654539 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-743f584c-8bf2-4a04-9610-c3119bf42518 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.169855 Jul 24 01:15:50.655319 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 270/519] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:50 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:51.506996 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-43f69d76-5d96-4973-94c8-4268db18c49c tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:51.507653 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-43f69d76-5d96-4973-94c8-4268db18c49c tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:51.514422 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-43f69d76-5d96-4973-94c8-4268db18c49c tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.514868 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-43f69d76-5d96-4973-94c8-4268db18c49c tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.515650 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-43f69d76-5d96-4973-94c8-4268db18c49c tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.516089 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-43f69d76-5d96-4973-94c8-4268db18c49c tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.596804 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-82fd36cb-99cc-4451-a025-47561dec0d37 req-e5b3d58b-a731-4667-8b2c-1f23557db18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2327f8ed-4fda-414b-a418-6dec644392d1", "name": "network-vif-plugged", "status": "completed", "tag": "98d0d35b-addc-4c7c-9d5e-e20031cea0cf"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:51.607192 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-82fd36cb-99cc-4451-a025-47561dec0d37 req-e5b3d58b-a731-4667-8b2c-1f23557db18e service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.607823 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-82fd36cb-99cc-4451-a025-47561dec0d37 req-e5b3d58b-a731-4667-8b2c-1f23557db18e service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.622027 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-82fd36cb-99cc-4451-a025-47561dec0d37 req-e5b3d58b-a731-4667-8b2c-1f23557db18e service nova] Creating event network-vif-plugged:98d0d35b-addc-4c7c-9d5e-e20031cea0cf for instance 2327f8ed-4fda-414b-a418-6dec644392d1 on hv-cinder-maste Jul 24 01:15:51.628010 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-82fd36cb-99cc-4451-a025-47561dec0d37 req-e5b3d58b-a731-4667-8b2c-1f23557db18e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034485 Jul 24 01:15:51.628750 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 271/520] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:51.656049 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-43f69d76-5d96-4973-94c8-4268db18c49c tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.663984 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-43f69d76-5d96-4973-94c8-4268db18c49c tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1318 microversion: 2.1 time: 0.160937 Jul 24 01:15:51.664558 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 250/521] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:51 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:51.672425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3250cf02-58b7-4bdd-b3a0-9b2522a50f92 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:51.673537 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3250cf02-58b7-4bdd-b3a0-9b2522a50f92 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:51.680303 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3250cf02-58b7-4bdd-b3a0-9b2522a50f92 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.680685 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3250cf02-58b7-4bdd-b3a0-9b2522a50f92 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.681444 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3250cf02-58b7-4bdd-b3a0-9b2522a50f92 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.681869 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3250cf02-58b7-4bdd-b3a0-9b2522a50f92 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.842762 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3250cf02-58b7-4bdd-b3a0-9b2522a50f92 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.851589 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3250cf02-58b7-4bdd-b3a0-9b2522a50f92 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.183438 Jul 24 01:15:51.852325 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 272/522] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:51 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:52.684242 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d05ae27e-942a-4e1a-9f38-bc1e393668cd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:52.684894 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d05ae27e-942a-4e1a-9f38-bc1e393668cd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:52.695102 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d05ae27e-942a-4e1a-9f38-bc1e393668cd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.695758 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d05ae27e-942a-4e1a-9f38-bc1e393668cd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.696896 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d05ae27e-942a-4e1a-9f38-bc1e393668cd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.697647 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d05ae27e-942a-4e1a-9f38-bc1e393668cd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.834278 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d05ae27e-942a-4e1a-9f38-bc1e393668cd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:52.837877 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:52.842914 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d05ae27e-942a-4e1a-9f38-bc1e393668cd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1318 microversion: 2.1 time: 0.164825 Jul 24 01:15:52.843540 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 251/523] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:52 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:52.869805 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d2247932-d72c-4719-9a6b-172fa3bd8f90 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:52.870416 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d2247932-d72c-4719-9a6b-172fa3bd8f90 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:52.872453 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:52.873135 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=8 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:52.879555 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d2247932-d72c-4719-9a6b-172fa3bd8f90 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.880014 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d2247932-d72c-4719-9a6b-172fa3bd8f90 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.880777 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d2247932-d72c-4719-9a6b-172fa3bd8f90 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.881212 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d2247932-d72c-4719-9a6b-172fa3bd8f90 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.019496 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d2247932-d72c-4719-9a6b-172fa3bd8f90 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:53.027913 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d2247932-d72c-4719-9a6b-172fa3bd8f90 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.162018 Jul 24 01:15:53.028589 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 273/524] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:52 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:53.860529 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-94bb7ba2-97b4-4158-9cc5-eeeb507d1c95 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:53.861072 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-94bb7ba2-97b4-4158-9cc5-eeeb507d1c95 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:53.868404 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-94bb7ba2-97b4-4158-9cc5-eeeb507d1c95 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.868851 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-94bb7ba2-97b4-4158-9cc5-eeeb507d1c95 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.869701 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-94bb7ba2-97b4-4158-9cc5-eeeb507d1c95 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.870129 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-94bb7ba2-97b4-4158-9cc5-eeeb507d1c95 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:54.011244 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-94bb7ba2-97b4-4158-9cc5-eeeb507d1c95 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:54.019117 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-94bb7ba2-97b4-4158-9cc5-eeeb507d1c95 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1507 microversion: 2.1 time: 0.163256 Jul 24 01:15:54.019720 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 252/525] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:53 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:54.036408 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-63097b07-4d6c-4082-8d35-c4388819991b tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00d19cd8-220d-46b2-aaf0-6344d9f403d3", "device": "/dev/sdb"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:54.037530 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-63097b07-4d6c-4082-8d35-c4388819991b tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:54.044347 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-63097b07-4d6c-4082-8d35-c4388819991b tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:54.044791 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-63097b07-4d6c-4082-8d35-c4388819991b tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:54.045008 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9fbd0d48-4a31-42e5-8e87-00498174f633 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:54.045548 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-63097b07-4d6c-4082-8d35-c4388819991b tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:54.045661 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9fbd0d48-4a31-42e5-8e87-00498174f633 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:54.045968 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-63097b07-4d6c-4082-8d35-c4388819991b tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:54.052162 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9fbd0d48-4a31-42e5-8e87-00498174f633 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:54.052610 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9fbd0d48-4a31-42e5-8e87-00498174f633 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:54.053369 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9fbd0d48-4a31-42e5-8e87-00498174f633 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:54.053798 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9fbd0d48-4a31-42e5-8e87-00498174f633 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:54.195572 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9fbd0d48-4a31-42e5-8e87-00498174f633 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:54.203932 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9fbd0d48-4a31-42e5-8e87-00498174f633 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1756 microversion: 2.1 time: 0.162777 Jul 24 01:15:54.204509 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 253/526] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:54 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:15:55.191709 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-63097b07-4d6c-4082-8d35-c4388819991b tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "POST /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.159118 Jul 24 01:15:55.192599 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 274/527] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:15:54 2022] POST /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1/os-volume_attachments => generated 194 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:55.221136 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-89a2a7c1-30a0-4097-9eb5-11152e5ab2f3 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:55.222336 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-89a2a7c1-30a0-4097-9eb5-11152e5ab2f3 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:55.228907 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-89a2a7c1-30a0-4097-9eb5-11152e5ab2f3 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:55.229356 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-89a2a7c1-30a0-4097-9eb5-11152e5ab2f3 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:55.230149 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-89a2a7c1-30a0-4097-9eb5-11152e5ab2f3 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:55.230578 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-89a2a7c1-30a0-4097-9eb5-11152e5ab2f3 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:55.380810 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-89a2a7c1-30a0-4097-9eb5-11152e5ab2f3 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:55.388835 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-89a2a7c1-30a0-4097-9eb5-11152e5ab2f3 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1759 microversion: 2.1 time: 0.171735 Jul 24 01:15:55.389398 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 254/528] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:55 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:57.916892 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-ef8aaffb-f7a2-4546-a7c8-415efb815271 req-0c109778-d967-41ed-9a6c-72b140e648ed admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "00d19cd8-220d-46b2-aaf0-6344d9f403d3", "create_info": {"type": "qcow2", "new_file": "volume-00d19cd8-220d-46b2-aaf0-6344d9f403d3.e50ec00f-59b4-4400-ba1e-84cf2b879334.vhdx", "snapshot_id": "e50ec00f-59b4-4400-ba1e-84cf2b879334"}}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:57.918959 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ef8aaffb-f7a2-4546-a7c8-415efb815271 req-0c109778-d967-41ed-9a6c-72b140e648ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.919425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ef8aaffb-f7a2-4546-a7c8-415efb815271 req-0c109778-d967-41ed-9a6c-72b140e648ed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.929120 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ef8aaffb-f7a2-4546-a7c8-415efb815271 req-0c109778-d967-41ed-9a6c-72b140e648ed admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.929552 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ef8aaffb-f7a2-4546-a7c8-415efb815271 req-0c109778-d967-41ed-9a6c-72b140e648ed admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.942762 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-ef8aaffb-f7a2-4546-a7c8-415efb815271 req-0c109778-d967-41ed-9a6c-72b140e648ed admin admin] 10.222.0.20 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.149106 Jul 24 01:15:57.943347 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 275/529] 10.222.0.20 () {64 vars in 1326 bytes} [Sun Jul 24 01:15:57 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:16:02.178451 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-020c2dbc-6eb2-4036-9c46-7d22471ab3d4 req-1deed633-c9d3-40a6-8238-453cebcdd2c1 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "00d19cd8-220d-46b2-aaf0-6344d9f403d3", "create_info": {"type": "qcow2", "new_file": "volume-00d19cd8-220d-46b2-aaf0-6344d9f403d3.29b2500b-89d0-48ef-9eda-4ce28900af95.vhdx", "snapshot_id": "29b2500b-89d0-48ef-9eda-4ce28900af95"}}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:02.180547 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-020c2dbc-6eb2-4036-9c46-7d22471ab3d4 req-1deed633-c9d3-40a6-8238-453cebcdd2c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:02.181059 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-020c2dbc-6eb2-4036-9c46-7d22471ab3d4 req-1deed633-c9d3-40a6-8238-453cebcdd2c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:02.189573 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-020c2dbc-6eb2-4036-9c46-7d22471ab3d4 req-1deed633-c9d3-40a6-8238-453cebcdd2c1 admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:02.190014 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-020c2dbc-6eb2-4036-9c46-7d22471ab3d4 req-1deed633-c9d3-40a6-8238-453cebcdd2c1 admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:02.204112 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-020c2dbc-6eb2-4036-9c46-7d22471ab3d4 req-1deed633-c9d3-40a6-8238-453cebcdd2c1 admin admin] 10.222.0.20 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.082684 Jul 24 01:16:02.204722 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 255/530] 10.222.0.20 () {64 vars in 1326 bytes} [Sun Jul 24 01:16:02 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:16:06.226678 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:06.276360 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-0a193dd5-5ac5-4e33-89e7-91bc49dd6e00 req-aa361ee8-f269-4a2f-b04e-cd8b57c18b7c admin admin] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:06.278330 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-0a193dd5-5ac5-4e33-89e7-91bc49dd6e00 req-aa361ee8-f269-4a2f-b04e-cd8b57c18b7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:06.278765 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-0a193dd5-5ac5-4e33-89e7-91bc49dd6e00 req-aa361ee8-f269-4a2f-b04e-cd8b57c18b7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:06.286926 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-0a193dd5-5ac5-4e33-89e7-91bc49dd6e00 req-aa361ee8-f269-4a2f-b04e-cd8b57c18b7c admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:06.287399 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-0a193dd5-5ac5-4e33-89e7-91bc49dd6e00 req-aa361ee8-f269-4a2f-b04e-cd8b57c18b7c admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:06.300625 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-0a193dd5-5ac5-4e33-89e7-91bc49dd6e00 req-aa361ee8-f269-4a2f-b04e-cd8b57c18b7c admin admin] 10.222.0.20 "DELETE /compute/v2.1/os-assisted-volume-snapshots/29b2500b-89d0-48ef-9eda-4ce28900af95?delete_info=%7B%22file_to_merge%22:%20%22volume-00d19cd8-220d-46b2-aaf0-6344d9f403d3.29b2500b-89d0-48ef-9eda-4ce28900af95.vhdx%22,%20%22volume_id%22:%20%2200d19cd8-220d-46b2-aaf0-6344d9f403d3%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.074972 Jul 24 01:16:06.301583 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 276/531] 10.222.0.20 () {62 vars in 1800 bytes} [Sun Jul 24 01:16:06 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/29b2500b-89d0-48ef-9eda-4ce28900af95?delete_info=%7B%22file_to_merge%22:%20%22volume-00d19cd8-220d-46b2-aaf0-6344d9f403d3.29b2500b-89d0-48ef-9eda-4ce28900af95.vhdx%22,%20%22volume_id%22:%20%2200d19cd8-220d-46b2-aaf0-6344d9f403d3%22%7D => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:10.472895 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:10.524694 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-a3a14a8e-f597-41a3-86a9-778f33fc1808 req-0fb05332-369f-426e-94a3-7a791d22bb80 admin admin] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:10.526981 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a3a14a8e-f597-41a3-86a9-778f33fc1808 req-0fb05332-369f-426e-94a3-7a791d22bb80 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:10.527453 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a3a14a8e-f597-41a3-86a9-778f33fc1808 req-0fb05332-369f-426e-94a3-7a791d22bb80 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:10.535669 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a3a14a8e-f597-41a3-86a9-778f33fc1808 req-0fb05332-369f-426e-94a3-7a791d22bb80 admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:10.536116 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a3a14a8e-f597-41a3-86a9-778f33fc1808 req-0fb05332-369f-426e-94a3-7a791d22bb80 admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:10.549410 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-a3a14a8e-f597-41a3-86a9-778f33fc1808 req-0fb05332-369f-426e-94a3-7a791d22bb80 admin admin] 10.222.0.20 "DELETE /compute/v2.1/os-assisted-volume-snapshots/8c91b532-8122-4e25-a76d-cbc56ce8dda0?delete_info=%7B%22file_to_merge%22:%20%22volume-00d19cd8-220d-46b2-aaf0-6344d9f403d3.8c91b532-8122-4e25-a76d-cbc56ce8dda0.vhdx%22,%20%22volume_id%22:%20%2200d19cd8-220d-46b2-aaf0-6344d9f403d3%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.077712 Jul 24 01:16:10.550409 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 256/532] 10.222.0.20 () {62 vars in 1800 bytes} [Sun Jul 24 01:16:10 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/8c91b532-8122-4e25-a76d-cbc56ce8dda0?delete_info=%7B%22file_to_merge%22:%20%22volume-00d19cd8-220d-46b2-aaf0-6344d9f403d3.8c91b532-8122-4e25-a76d-cbc56ce8dda0.vhdx%22,%20%22volume_id%22:%20%2200d19cd8-220d-46b2-aaf0-6344d9f403d3%22%7D => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:14.746891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-99c4496f-5b65-43ca-9feb-867bea39d1b8 req-cc53a4a5-e3ae-4437-b88d-99622dbe15be admin admin] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:14.748978 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-99c4496f-5b65-43ca-9feb-867bea39d1b8 req-cc53a4a5-e3ae-4437-b88d-99622dbe15be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:14.749411 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-99c4496f-5b65-43ca-9feb-867bea39d1b8 req-cc53a4a5-e3ae-4437-b88d-99622dbe15be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:14.758380 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-99c4496f-5b65-43ca-9feb-867bea39d1b8 req-cc53a4a5-e3ae-4437-b88d-99622dbe15be admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:14.758834 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-99c4496f-5b65-43ca-9feb-867bea39d1b8 req-cc53a4a5-e3ae-4437-b88d-99622dbe15be admin admin] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:14.761616 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:14.773007 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-99c4496f-5b65-43ca-9feb-867bea39d1b8 req-cc53a4a5-e3ae-4437-b88d-99622dbe15be admin admin] 10.222.0.20 "DELETE /compute/v2.1/os-assisted-volume-snapshots/e50ec00f-59b4-4400-ba1e-84cf2b879334?delete_info=%7B%22file_to_merge%22:%20%22volume-00d19cd8-220d-46b2-aaf0-6344d9f403d3.e50ec00f-59b4-4400-ba1e-84cf2b879334.vhdx%22,%20%22volume_id%22:%20%2200d19cd8-220d-46b2-aaf0-6344d9f403d3%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.083607 Jul 24 01:16:14.773587 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 277/533] 10.222.0.20 () {62 vars in 1800 bytes} [Sun Jul 24 01:16:14 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/e50ec00f-59b4-4400-ba1e-84cf2b879334?delete_info=%7B%22file_to_merge%22:%20%22volume-00d19cd8-220d-46b2-aaf0-6344d9f403d3.e50ec00f-59b4-4400-ba1e-84cf2b879334.vhdx%22,%20%22volume_id%22:%20%2200d19cd8-220d-46b2-aaf0-6344d9f403d3%22%7D => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:16:18.718358 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b247fe47-4bec-4c61-98ed-acc327d104e9 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:18.718942 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b247fe47-4bec-4c61-98ed-acc327d104e9 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:18.727819 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b247fe47-4bec-4c61-98ed-acc327d104e9 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:18.728494 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b247fe47-4bec-4c61-98ed-acc327d104e9 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:18.729593 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b247fe47-4bec-4c61-98ed-acc327d104e9 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:18.730251 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b247fe47-4bec-4c61-98ed-acc327d104e9 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:18.856870 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-b247fe47-4bec-4c61-98ed-acc327d104e9 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lazy-loading 'services' on Instance uuid 2327f8ed-4fda-414b-a418-6dec644392d1 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:18.983586 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b247fe47-4bec-4c61-98ed-acc327d104e9 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1/os-volume_attachments/00d19cd8-220d-46b2-aaf0-6344d9f403d3" status: 202 len: 0 microversion: 2.1 time: 0.271785 Jul 24 01:16:18.984229 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 257/534] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:16:18 2022] DELETE /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1/os-volume_attachments/00d19cd8-220d-46b2-aaf0-6344d9f403d3 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:21.164700 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1699b363-c365-40b5-9f51-c8a4e21fc0dc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:21.165251 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1699b363-c365-40b5-9f51-c8a4e21fc0dc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:21.172585 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1699b363-c365-40b5-9f51-c8a4e21fc0dc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:21.173039 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1699b363-c365-40b5-9f51-c8a4e21fc0dc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:21.173803 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1699b363-c365-40b5-9f51-c8a4e21fc0dc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:21.174239 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1699b363-c365-40b5-9f51-c8a4e21fc0dc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:21.201286 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1699b363-c365-40b5-9f51-c8a4e21fc0dc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:21.281413 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1699b363-c365-40b5-9f51-c8a4e21fc0dc tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 204 len: 0 microversion: 2.1 time: 0.121494 Jul 24 01:16:21.282058 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 278/535] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:21 2022] DELETE /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:21.288520 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=4 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:21.292842 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e1148a50-b2ae-4d70-bf61-a91f19d51982 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:21.293546 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e1148a50-b2ae-4d70-bf61-a91f19d51982 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:21.300581 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e1148a50-b2ae-4d70-bf61-a91f19d51982 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:21.301031 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e1148a50-b2ae-4d70-bf61-a91f19d51982 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:21.301798 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e1148a50-b2ae-4d70-bf61-a91f19d51982 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:21.302232 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e1148a50-b2ae-4d70-bf61-a91f19d51982 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:21.434371 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e1148a50-b2ae-4d70-bf61-a91f19d51982 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:21.442404 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e1148a50-b2ae-4d70-bf61-a91f19d51982 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1513 microversion: 2.1 time: 0.155376 Jul 24 01:16:21.442971 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 258/536] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:21 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:22.464662 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-43e8ce71-548d-4f81-a24b-79a9d993a1f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:22.465966 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-43e8ce71-548d-4f81-a24b-79a9d993a1f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:22.477197 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-43e8ce71-548d-4f81-a24b-79a9d993a1f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.477997 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-43e8ce71-548d-4f81-a24b-79a9d993a1f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.479346 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-43e8ce71-548d-4f81-a24b-79a9d993a1f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.480095 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-43e8ce71-548d-4f81-a24b-79a9d993a1f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.612933 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-43e8ce71-548d-4f81-a24b-79a9d993a1f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:22.621097 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-43e8ce71-548d-4f81-a24b-79a9d993a1f5 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1513 microversion: 2.1 time: 0.163833 Jul 24 01:16:22.621673 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 279/537] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:22 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:23.641737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-aef86eb9-4b2b-4a95-b942-b372dddbb6dd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:23.642698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-aef86eb9-4b2b-4a95-b942-b372dddbb6dd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:23.651636 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-aef86eb9-4b2b-4a95-b942-b372dddbb6dd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:23.652080 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-aef86eb9-4b2b-4a95-b942-b372dddbb6dd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:23.652838 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-aef86eb9-4b2b-4a95-b942-b372dddbb6dd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:23.653267 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-aef86eb9-4b2b-4a95-b942-b372dddbb6dd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:23.787084 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-aef86eb9-4b2b-4a95-b942-b372dddbb6dd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:23.795328 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-aef86eb9-4b2b-4a95-b942-b372dddbb6dd tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1513 microversion: 2.1 time: 0.160198 Jul 24 01:16:23.795926 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 259/538] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:23 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:24.817156 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5b8948ee-2f00-4412-bc89-051d32a074a8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:24.818150 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-5b8948ee-2f00-4412-bc89-051d32a074a8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:24.821060 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=6 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:24.826937 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5b8948ee-2f00-4412-bc89-051d32a074a8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:24.827406 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5b8948ee-2f00-4412-bc89-051d32a074a8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:24.828173 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5b8948ee-2f00-4412-bc89-051d32a074a8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:24.828591 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5b8948ee-2f00-4412-bc89-051d32a074a8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:24.958128 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-5b8948ee-2f00-4412-bc89-051d32a074a8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:24.965897 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5b8948ee-2f00-4412-bc89-051d32a074a8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1513 microversion: 2.1 time: 0.155302 Jul 24 01:16:24.966475 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 280/539] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:24 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:25.987333 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-019dee5a-e1b9-4bff-a07d-c579fdd9eaf6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:25.988349 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-019dee5a-e1b9-4bff-a07d-c579fdd9eaf6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:25.996345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-019dee5a-e1b9-4bff-a07d-c579fdd9eaf6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.996794 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-019dee5a-e1b9-4bff-a07d-c579fdd9eaf6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.997557 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-019dee5a-e1b9-4bff-a07d-c579fdd9eaf6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.997994 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-019dee5a-e1b9-4bff-a07d-c579fdd9eaf6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.000602 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:26.128858 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-019dee5a-e1b9-4bff-a07d-c579fdd9eaf6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:26.136853 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-019dee5a-e1b9-4bff-a07d-c579fdd9eaf6 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1513 microversion: 2.1 time: 0.156039 Jul 24 01:16:26.137427 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 260/540] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:25 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:26.919970 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-88bf4097-07ef-4c8e-b2e0-6cae213c5157 req-9d9b9186-6f1f-4e11-969b-667c0e98163e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2327f8ed-4fda-414b-a418-6dec644392d1", "name": "network-vif-deleted", "tag": "98d0d35b-addc-4c7c-9d5e-e20031cea0cf"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:26.931478 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-88bf4097-07ef-4c8e-b2e0-6cae213c5157 req-9d9b9186-6f1f-4e11-969b-667c0e98163e service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.931908 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-88bf4097-07ef-4c8e-b2e0-6cae213c5157 req-9d9b9186-6f1f-4e11-969b-667c0e98163e service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.943401 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-88bf4097-07ef-4c8e-b2e0-6cae213c5157 req-9d9b9186-6f1f-4e11-969b-667c0e98163e service nova] Creating event network-vif-deleted:98d0d35b-addc-4c7c-9d5e-e20031cea0cf for instance 2327f8ed-4fda-414b-a418-6dec644392d1 on hv-cinder-maste Jul 24 01:16:26.948632 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-88bf4097-07ef-4c8e-b2e0-6cae213c5157 req-9d9b9186-6f1f-4e11-969b-667c0e98163e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Jul 24 01:16:26.949238 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 281/541] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:27.156790 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:27.157652 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:27.166382 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.166864 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.167672 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.168106 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.199324 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.199800 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.200243 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lazy-loading 'fault' on Instance uuid 2327f8ed-4fda-414b-a418-6dec644392d1 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:27.246003 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e93b46abca4638a2c5ca6615c8972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:27.253818 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d3e37551-6796-4338-84ad-d7e9c992a902 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 200 len: 1308 microversion: 2.1 time: 0.103173 Jul 24 01:16:27.254390 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 261/542] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:27 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:27.926493 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-99a375e7-8fe3-4900-b430-aa3e1c039afa tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:27.927352 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-99a375e7-8fe3-4900-b430-aa3e1c039afa tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:27.938571 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-99a375e7-8fe3-4900-b430-aa3e1c039afa tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.939375 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-99a375e7-8fe3-4900-b430-aa3e1c039afa tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.940628 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-99a375e7-8fe3-4900-b430-aa3e1c039afa tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.941349 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-99a375e7-8fe3-4900-b430-aa3e1c039afa tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.024132 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-99a375e7-8fe3-4900-b430-aa3e1c039afa tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lazy-loading 'services' on Instance uuid 76c12186-86f3-4887-9e0a-ed1b48f307ba {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:28.100016 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-99a375e7-8fe3-4900-b430-aa3e1c039afa tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/os-volume_attachments/36626d01-bdc1-433c-b600-006e589bfc6b" status: 202 len: 0 microversion: 2.1 time: 0.181231 Jul 24 01:16:28.100666 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 282/543] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:16:27 2022] DELETE /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/os-volume_attachments/36626d01-bdc1-433c-b600-006e589bfc6b => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:28.275737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:28.276847 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] [instance: 2327f8ed-4fda-414b-a418-6dec644392d1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:28.293900 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.294652 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.298421 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.299504 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.317852 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] HTTP exception thrown: Instance 2327f8ed-4fda-414b-a418-6dec644392d1 could not be found. Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Request method failure captured: Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 HTTP/1.1 Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JzLpnkH3Pf6NYd0yPTegcZBM2TLG-8nHul6RVKqdYcHiRgLt1kppLIsLXaHehU87DwhReKvhcz_SVMqyqJE8y6kyGTrluresMVpsmYCnINDS1d8oOqtltIrnPQaevfWuv2RJ865Kn2VKHpBxkY1Hp4pVg5WtcD3pQhzxe9YrEmwwuQ Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: f939fe11bf294c2e92ed1f8e9c5d43e2 Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1757858 Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:16:28.319558 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f939fe11bf294c2e92ed1f8e9c5d43e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f939fe11bf294c2e92ed1f8e9c5d43e2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f939fe11bf294c2e92ed1f8e9c5d43e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f939fe11bf294c2e92ed1f8e9c5d43e2"}]}] Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesSnapshotTestJSON-1757858 Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: f939fe11bf294c2e92ed1f8e9c5d43e2 Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1757858 Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesSnapshotTestJSON-1757858-project Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: b6e93b46abca4638a2c5ca6615c8972a Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesSnapshotTestJSON-1757858-project Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 2327f8ed-4fda-414b-a418-6dec644392d1 could not be found. Jul 24 01:16:28.321095 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '2327f8ed-4fda-414b-a418-6dec644392d1'} Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2327f8ed-4fda-414b-a418-6dec644392d1 could not be found. Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:28.321981 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2327f8ed-4fda-414b-a418-6dec644392d1 could not be found. Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2327f8ed-4fda-414b-a418-6dec644392d1 could not be found. Jul 24 01:16:28.323532 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:28.324864 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] Returning 404 to user: Instance 2327f8ed-4fda-414b-a418-6dec644392d1 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:28.324864 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1b48de50-8da3-49e3-9ec9-fe25898318e8 tempest-VolumesSnapshotTestJSON-1757858 tempest-VolumesSnapshotTestJSON-1757858-project] 10.222.0.42 "GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1" status: 404 len: 111 microversion: 2.1 time: 0.052024 Jul 24 01:16:28.324864 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 262/544] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:28 2022] GET /compute/v2.1/servers/2327f8ed-4fda-414b-a418-6dec644392d1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:29.222153 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b113178c-fa0d-4e4c-80d4-78aa974fa421 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:29.229063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b113178c-fa0d-4e4c-80d4-78aa974fa421 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:29.229477 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b113178c-fa0d-4e4c-80d4-78aa974fa421 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:29.251688 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b113178c-fa0d-4e4c-80d4-78aa974fa421 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Going to try to stop instance {{(pid=118035) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:16:29.293638 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b113178c-fa0d-4e4c-80d4-78aa974fa421 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/action" status: 202 len: 0 microversion: 2.1 time: 0.076013 Jul 24 01:16:29.294242 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 283/545] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:29 2022] POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:29.302803 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2e768d63-36b1-467d-93e1-226007f0cc9d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:29.303483 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2e768d63-36b1-467d-93e1-226007f0cc9d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:29.310289 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2e768d63-36b1-467d-93e1-226007f0cc9d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:29.310808 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2e768d63-36b1-467d-93e1-226007f0cc9d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:29.311643 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2e768d63-36b1-467d-93e1-226007f0cc9d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:29.312064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2e768d63-36b1-467d-93e1-226007f0cc9d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:29.444805 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2e768d63-36b1-467d-93e1-226007f0cc9d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:29.452676 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2e768d63-36b1-467d-93e1-226007f0cc9d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1679 microversion: 2.1 time: 0.154093 Jul 24 01:16:29.453236 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 263/546] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:29 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:30.475860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-267350c4-7979-4572-8ab1-563be6d7f45e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:30.477017 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-267350c4-7979-4572-8ab1-563be6d7f45e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:30.487644 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-267350c4-7979-4572-8ab1-563be6d7f45e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.488398 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-267350c4-7979-4572-8ab1-563be6d7f45e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.489656 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-267350c4-7979-4572-8ab1-563be6d7f45e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.490378 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-267350c4-7979-4572-8ab1-563be6d7f45e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.633953 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-267350c4-7979-4572-8ab1-563be6d7f45e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:30.641663 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-267350c4-7979-4572-8ab1-563be6d7f45e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1679 microversion: 2.1 time: 0.173670 Jul 24 01:16:30.642231 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 284/547] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:30 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:31.663696 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-65d74ec1-e2e4-408e-815e-2dc43f401fa0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:31.664310 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-65d74ec1-e2e4-408e-815e-2dc43f401fa0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:31.671207 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-65d74ec1-e2e4-408e-815e-2dc43f401fa0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:31.671690 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-65d74ec1-e2e4-408e-815e-2dc43f401fa0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:31.672441 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-65d74ec1-e2e4-408e-815e-2dc43f401fa0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:31.672865 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-65d74ec1-e2e4-408e-815e-2dc43f401fa0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:31.802590 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-65d74ec1-e2e4-408e-815e-2dc43f401fa0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:31.810319 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-65d74ec1-e2e4-408e-815e-2dc43f401fa0 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1679 microversion: 2.1 time: 0.153275 Jul 24 01:16:31.810880 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 264/548] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:31 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:32.026325 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0c76da56-f4cd-467a-bf12-4f161d7117ec tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a93f31a1-765a-4766-b47e-6739ec74b9b6"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:32.027568 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0c76da56-f4cd-467a-bf12-4f161d7117ec tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:32.035562 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0c76da56-f4cd-467a-bf12-4f161d7117ec tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:32.036009 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0c76da56-f4cd-467a-bf12-4f161d7117ec tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:32.036761 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0c76da56-f4cd-467a-bf12-4f161d7117ec tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:32.037195 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0c76da56-f4cd-467a-bf12-4f161d7117ec tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:32.313479 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0c76da56-f4cd-467a-bf12-4f161d7117ec tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293200 Jul 24 01:16:32.314121 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 285/549] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:16:32 2022] POST /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:32.827179 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e6568740-f311-4f65-9095-49db755a7238 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:32.827834 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e6568740-f311-4f65-9095-49db755a7238 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:32.834860 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e6568740-f311-4f65-9095-49db755a7238 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:32.835329 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e6568740-f311-4f65-9095-49db755a7238 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:32.836092 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e6568740-f311-4f65-9095-49db755a7238 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:32.836508 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e6568740-f311-4f65-9095-49db755a7238 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:32.971225 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e6568740-f311-4f65-9095-49db755a7238 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:32.979324 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e6568740-f311-4f65-9095-49db755a7238 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1679 microversion: 2.1 time: 0.156000 Jul 24 01:16:32.979925 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 265/550] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:32 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:33.997085 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7d911d9f-23c0-4a85-b840-944b188aff5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:33.997789 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7d911d9f-23c0-4a85-b840-944b188aff5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:34.004792 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7d911d9f-23c0-4a85-b840-944b188aff5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.005244 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7d911d9f-23c0-4a85-b840-944b188aff5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:34.006026 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7d911d9f-23c0-4a85-b840-944b188aff5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.006457 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7d911d9f-23c0-4a85-b840-944b188aff5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:34.141456 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7d911d9f-23c0-4a85-b840-944b188aff5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:34.149534 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7d911d9f-23c0-4a85-b840-944b188aff5a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1679 microversion: 2.1 time: 0.157266 Jul 24 01:16:34.150120 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 286/551] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:33 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:34.557757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-afc3eb6d-6874-4850-a360-e9548662abee tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:34.558769 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-afc3eb6d-6874-4850-a360-e9548662abee tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:34.565909 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-afc3eb6d-6874-4850-a360-e9548662abee tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.566358 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-afc3eb6d-6874-4850-a360-e9548662abee tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:34.567124 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-afc3eb6d-6874-4850-a360-e9548662abee tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.567652 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-afc3eb6d-6874-4850-a360-e9548662abee tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:34.589536 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-afc3eb6d-6874-4850-a360-e9548662abee tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lazy-loading 'flavor' on Instance uuid d614ca48-40f2-4927-a2a9-65a14f2fe0a1 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:34.762736 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-afc3eb6d-6874-4850-a360-e9548662abee tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/action" status: 200 len: 32 microversion: 2.1 time: 0.208892 Jul 24 01:16:34.763427 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 266/552] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:34 2022] POST /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:16:34.772443 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-53bf5f8f-3359-4022-9774-5d699e7751ff tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:34.773065 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-53bf5f8f-3359-4022-9774-5d699e7751ff tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:34.780281 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53bf5f8f-3359-4022-9774-5d699e7751ff tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.780761 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53bf5f8f-3359-4022-9774-5d699e7751ff tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:34.781565 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53bf5f8f-3359-4022-9774-5d699e7751ff tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.782015 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-53bf5f8f-3359-4022-9774-5d699e7751ff tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:34.913638 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-53bf5f8f-3359-4022-9774-5d699e7751ff tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:34.921716 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-53bf5f8f-3359-4022-9774-5d699e7751ff tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.153140 Jul 24 01:16:34.922299 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 287/553] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:34 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:35.167676 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d07ef805-8f81-47ea-850e-af7b7ce5ee35 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:35.168397 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d07ef805-8f81-47ea-850e-af7b7ce5ee35 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:35.175423 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d07ef805-8f81-47ea-850e-af7b7ce5ee35 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.175856 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d07ef805-8f81-47ea-850e-af7b7ce5ee35 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.176628 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d07ef805-8f81-47ea-850e-af7b7ce5ee35 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.177051 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d07ef805-8f81-47ea-850e-af7b7ce5ee35 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.307798 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d07ef805-8f81-47ea-850e-af7b7ce5ee35 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:35.315665 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d07ef805-8f81-47ea-850e-af7b7ce5ee35 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1679 microversion: 2.1 time: 0.152267 Jul 24 01:16:35.316214 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 267/554] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:35 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:35.939328 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a1056535-5322-4c5b-84f5-fb8a0bc69db3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:35.939891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a1056535-5322-4c5b-84f5-fb8a0bc69db3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:35.946498 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1056535-5322-4c5b-84f5-fb8a0bc69db3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.946946 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1056535-5322-4c5b-84f5-fb8a0bc69db3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.947785 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1056535-5322-4c5b-84f5-fb8a0bc69db3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.948221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1056535-5322-4c5b-84f5-fb8a0bc69db3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.082668 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a1056535-5322-4c5b-84f5-fb8a0bc69db3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:36.090858 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a1056535-5322-4c5b-84f5-fb8a0bc69db3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.155680 Jul 24 01:16:36.091495 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 288/555] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:35 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:36.337378 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-64beacee-5fbd-437f-bfb4-539ec613a846 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:36.338684 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-64beacee-5fbd-437f-bfb4-539ec613a846 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:36.349898 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-64beacee-5fbd-437f-bfb4-539ec613a846 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.350708 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-64beacee-5fbd-437f-bfb4-539ec613a846 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.351535 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-64beacee-5fbd-437f-bfb4-539ec613a846 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.351970 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-64beacee-5fbd-437f-bfb4-539ec613a846 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.486848 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-64beacee-5fbd-437f-bfb4-539ec613a846 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:36.494670 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-64beacee-5fbd-437f-bfb4-539ec613a846 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1679 microversion: 2.1 time: 0.163764 Jul 24 01:16:36.495229 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 268/556] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:36 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:37.107869 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3c13e9bd-83cd-46d4-88e1-72a7f8f757e8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:37.108575 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3c13e9bd-83cd-46d4-88e1-72a7f8f757e8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:37.115508 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3c13e9bd-83cd-46d4-88e1-72a7f8f757e8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:37.116028 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3c13e9bd-83cd-46d4-88e1-72a7f8f757e8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:37.116793 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3c13e9bd-83cd-46d4-88e1-72a7f8f757e8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:37.117229 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3c13e9bd-83cd-46d4-88e1-72a7f8f757e8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:37.254536 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3c13e9bd-83cd-46d4-88e1-72a7f8f757e8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:37.263437 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3c13e9bd-83cd-46d4-88e1-72a7f8f757e8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.159449 Jul 24 01:16:37.264012 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 289/557] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:37 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:37.516403 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-08c0d57f-2672-466b-81b2-b3c471d86c09 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:37.517651 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-08c0d57f-2672-466b-81b2-b3c471d86c09 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:37.526303 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-08c0d57f-2672-466b-81b2-b3c471d86c09 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:37.526744 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-08c0d57f-2672-466b-81b2-b3c471d86c09 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:37.527548 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-08c0d57f-2672-466b-81b2-b3c471d86c09 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:37.527974 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-08c0d57f-2672-466b-81b2-b3c471d86c09 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:37.661091 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-08c0d57f-2672-466b-81b2-b3c471d86c09 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:37.669251 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-08c0d57f-2672-466b-81b2-b3c471d86c09 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1679 microversion: 2.1 time: 0.159564 Jul 24 01:16:37.669842 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 269/558] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:37 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:38.284937 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-40195815-f473-48e9-ba24-7f6895ce33d3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:38.285797 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-40195815-f473-48e9-ba24-7f6895ce33d3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:38.294056 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-40195815-f473-48e9-ba24-7f6895ce33d3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.294498 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-40195815-f473-48e9-ba24-7f6895ce33d3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.295251 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-40195815-f473-48e9-ba24-7f6895ce33d3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.295712 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-40195815-f473-48e9-ba24-7f6895ce33d3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.312610 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:38.431660 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-40195815-f473-48e9-ba24-7f6895ce33d3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:38.439963 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-40195815-f473-48e9-ba24-7f6895ce33d3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.161569 Jul 24 01:16:38.440516 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 290/559] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:38 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:38.687171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b9ad0fb5-d56a-4ae2-88ae-1c6d05d3bec6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:38.687782 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b9ad0fb5-d56a-4ae2-88ae-1c6d05d3bec6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:38.694586 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b9ad0fb5-d56a-4ae2-88ae-1c6d05d3bec6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.695131 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b9ad0fb5-d56a-4ae2-88ae-1c6d05d3bec6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.697166 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b9ad0fb5-d56a-4ae2-88ae-1c6d05d3bec6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.697630 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b9ad0fb5-d56a-4ae2-88ae-1c6d05d3bec6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.826689 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b9ad0fb5-d56a-4ae2-88ae-1c6d05d3bec6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:38.834594 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b9ad0fb5-d56a-4ae2-88ae-1c6d05d3bec6 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1679 microversion: 2.1 time: 0.151843 Jul 24 01:16:38.835153 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 270/560] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:38 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:39.459685 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0b3123a2-002a-43e4-984d-f615738a934b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:39.460164 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0b3123a2-002a-43e4-984d-f615738a934b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:39.467248 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0b3123a2-002a-43e4-984d-f615738a934b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:39.467797 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0b3123a2-002a-43e4-984d-f615738a934b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:39.468567 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0b3123a2-002a-43e4-984d-f615738a934b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:39.469007 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0b3123a2-002a-43e4-984d-f615738a934b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:39.606146 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0b3123a2-002a-43e4-984d-f615738a934b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:39.614476 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0b3123a2-002a-43e4-984d-f615738a934b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.158854 Jul 24 01:16:39.615093 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 291/561] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:39 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:39.853554 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-922733c8-8c26-464e-815e-17591c8aa984 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:39.854227 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-922733c8-8c26-464e-815e-17591c8aa984 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:39.861258 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-922733c8-8c26-464e-815e-17591c8aa984 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:39.861699 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-922733c8-8c26-464e-815e-17591c8aa984 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:39.862449 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-922733c8-8c26-464e-815e-17591c8aa984 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:39.862873 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-922733c8-8c26-464e-815e-17591c8aa984 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:39.993018 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-922733c8-8c26-464e-815e-17591c8aa984 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:40.000594 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-922733c8-8c26-464e-815e-17591c8aa984 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1656 microversion: 2.1 time: 0.151150 Jul 24 01:16:40.001138 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 271/562] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:39 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:40.017158 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d033edeb-8ae7-4910-bc31-c6fc069009c1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:40.023432 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d033edeb-8ae7-4910-bc31-c6fc069009c1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.023883 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d033edeb-8ae7-4910-bc31-c6fc069009c1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.045825 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d033edeb-8ae7-4910-bc31-c6fc069009c1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Going to try to start instance {{(pid=118035) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 24 01:16:40.091321 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d033edeb-8ae7-4910-bc31-c6fc069009c1 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/action" status: 202 len: 0 microversion: 2.1 time: 0.077805 Jul 24 01:16:40.091818 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 292/563] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:40 2022] POST /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:40.100711 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4d5adeba-97b4-4a10-8a86-191fafa2acd2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:40.101319 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4d5adeba-97b4-4a10-8a86-191fafa2acd2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:40.107714 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4d5adeba-97b4-4a10-8a86-191fafa2acd2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.108155 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4d5adeba-97b4-4a10-8a86-191fafa2acd2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.109026 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4d5adeba-97b4-4a10-8a86-191fafa2acd2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.109436 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4d5adeba-97b4-4a10-8a86-191fafa2acd2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.242226 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4d5adeba-97b4-4a10-8a86-191fafa2acd2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:40.249976 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4d5adeba-97b4-4a10-8a86-191fafa2acd2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1665 microversion: 2.1 time: 0.153084 Jul 24 01:16:40.250555 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 272/564] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:40 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:40.633179 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b276b641-b061-4a8f-9527-3b63622a15a2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:40.633932 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b276b641-b061-4a8f-9527-3b63622a15a2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:40.641143 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b276b641-b061-4a8f-9527-3b63622a15a2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.641583 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b276b641-b061-4a8f-9527-3b63622a15a2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.642367 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b276b641-b061-4a8f-9527-3b63622a15a2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.642820 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b276b641-b061-4a8f-9527-3b63622a15a2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.882344 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b276b641-b061-4a8f-9527-3b63622a15a2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:40.891926 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b276b641-b061-4a8f-9527-3b63622a15a2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.263339 Jul 24 01:16:40.892584 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 293/565] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:40 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:41.267185 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-73b20960-bfa7-4efd-9e1f-ec9edcb5e92a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:41.267794 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-73b20960-bfa7-4efd-9e1f-ec9edcb5e92a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:41.270262 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=35 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:41.275524 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-73b20960-bfa7-4efd-9e1f-ec9edcb5e92a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.275962 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-73b20960-bfa7-4efd-9e1f-ec9edcb5e92a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:41.276715 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-73b20960-bfa7-4efd-9e1f-ec9edcb5e92a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.277140 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-73b20960-bfa7-4efd-9e1f-ec9edcb5e92a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:41.407932 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-73b20960-bfa7-4efd-9e1f-ec9edcb5e92a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:41.416188 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-73b20960-bfa7-4efd-9e1f-ec9edcb5e92a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1665 microversion: 2.1 time: 0.152962 Jul 24 01:16:41.416727 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 273/566] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:41 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:41.909465 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-778b2ff1-b0d7-48d7-b53c-fe147b0bfa8d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:41.910080 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-778b2ff1-b0d7-48d7-b53c-fe147b0bfa8d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:41.916886 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-778b2ff1-b0d7-48d7-b53c-fe147b0bfa8d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.917393 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-778b2ff1-b0d7-48d7-b53c-fe147b0bfa8d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:41.918155 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-778b2ff1-b0d7-48d7-b53c-fe147b0bfa8d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.918600 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-778b2ff1-b0d7-48d7-b53c-fe147b0bfa8d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.056617 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-778b2ff1-b0d7-48d7-b53c-fe147b0bfa8d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:42.065013 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-778b2ff1-b0d7-48d7-b53c-fe147b0bfa8d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.159498 Jul 24 01:16:42.065601 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 294/567] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:41 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:42.440095 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-98ca9eac-fc34-4cea-a9fa-b7073a162af3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:42.440699 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-98ca9eac-fc34-4cea-a9fa-b7073a162af3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:42.447848 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-98ca9eac-fc34-4cea-a9fa-b7073a162af3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.448293 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-98ca9eac-fc34-4cea-a9fa-b7073a162af3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.449043 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-98ca9eac-fc34-4cea-a9fa-b7073a162af3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.449473 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-98ca9eac-fc34-4cea-a9fa-b7073a162af3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.644959 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-98ca9eac-fc34-4cea-a9fa-b7073a162af3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:42.652742 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-98ca9eac-fc34-4cea-a9fa-b7073a162af3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1669 microversion: 2.1 time: 0.216544 Jul 24 01:16:42.653269 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 274/568] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:42 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1669 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:43.083020 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ea9abd21-4efa-4374-b4af-05075a1faeef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:43.083820 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ea9abd21-4efa-4374-b4af-05075a1faeef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:43.090822 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ea9abd21-4efa-4374-b4af-05075a1faeef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:43.091263 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ea9abd21-4efa-4374-b4af-05075a1faeef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:43.092043 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ea9abd21-4efa-4374-b4af-05075a1faeef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:43.092477 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ea9abd21-4efa-4374-b4af-05075a1faeef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:43.231962 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ea9abd21-4efa-4374-b4af-05075a1faeef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:43.240564 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ea9abd21-4efa-4374-b4af-05075a1faeef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.161538 Jul 24 01:16:43.241140 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 295/569] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:43 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:44.261475 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-15f36cb0-f72f-4f92-aac6-d52a20dc1d5d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:44.262083 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-15f36cb0-f72f-4f92-aac6-d52a20dc1d5d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:44.269017 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-15f36cb0-f72f-4f92-aac6-d52a20dc1d5d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:44.269530 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-15f36cb0-f72f-4f92-aac6-d52a20dc1d5d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:44.270311 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-15f36cb0-f72f-4f92-aac6-d52a20dc1d5d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:44.270747 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-15f36cb0-f72f-4f92-aac6-d52a20dc1d5d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:44.273476 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:44.404802 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-15f36cb0-f72f-4f92-aac6-d52a20dc1d5d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:44.412874 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-15f36cb0-f72f-4f92-aac6-d52a20dc1d5d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.156987 Jul 24 01:16:44.413413 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 275/570] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:44 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:45.430957 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0bad8870-d9a5-4e42-84d9-a00abe235f78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:45.432002 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0bad8870-d9a5-4e42-84d9-a00abe235f78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:45.438299 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0bad8870-d9a5-4e42-84d9-a00abe235f78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:45.438757 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0bad8870-d9a5-4e42-84d9-a00abe235f78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:45.439643 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0bad8870-d9a5-4e42-84d9-a00abe235f78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:45.440060 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0bad8870-d9a5-4e42-84d9-a00abe235f78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:45.582829 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0bad8870-d9a5-4e42-84d9-a00abe235f78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:45.591513 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0bad8870-d9a5-4e42-84d9-a00abe235f78 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.164795 Jul 24 01:16:45.592086 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 296/571] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:45 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:46.017393 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ad8f285f-6296-49e1-b3a2-6343ec89f4c2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:46.018283 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ad8f285f-6296-49e1-b3a2-6343ec89f4c2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:46.029210 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ad8f285f-6296-49e1-b3a2-6343ec89f4c2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.029961 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ad8f285f-6296-49e1-b3a2-6343ec89f4c2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.031215 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ad8f285f-6296-49e1-b3a2-6343ec89f4c2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.031981 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ad8f285f-6296-49e1-b3a2-6343ec89f4c2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.059063 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ad8f285f-6296-49e1-b3a2-6343ec89f4c2 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124/ips" status: 200 len: 150 microversion: 2.1 time: 0.048242 Jul 24 01:16:46.059651 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 276/572] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:16:46 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:46.072722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5868751f-c6d5-4175-a7e9-e5457b67fc9b"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:46.073920 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:46.080531 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.080973 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.081730 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.082158 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.163446 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Invalid volume: volume 5868751f-c6d5-4175-a7e9-e5457b67fc9b is already attached to instances: e5b4f90c-bd24-4e24-9175-7c8bb57f1245 Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: POST /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124/os-volume_attachments HTTP/1.1 Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 74 Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:16:46.165150 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: {"volumeAttachment": {"volumeId": "5868751f-c6d5-4175-a7e9-e5457b67fc9b"}} Jul 24 01:16:46.166695 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Invalid volume: volume 5868751f-c6d5-4175-a7e9-e5457b67fc9b is already attached to instances: e5b4f90c-bd24-4e24-9175-7c8bb57f1245 Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'server_id': 'c74d4adf-6c79-421f-b475-3eb478eb2124', 'body': {'volumeAttachment': {'volumeId': '5868751f-c6d5-4175-a7e9-e5457b67fc9b'}}} Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5868751f-c6d5-4175-a7e9-e5457b67fc9b is already attached to instances: e5b4f90c-bd24-4e24-9175-7c8bb57f1245 Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:46.167655 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5868751f-c6d5-4175-a7e9-e5457b67fc9b is already attached to instances: e5b4f90c-bd24-4e24-9175-7c8bb57f1245 Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:46.168885 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:46.170083 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:46.170083 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:46.170083 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:46.170083 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5868751f-c6d5-4175-a7e9-e5457b67fc9b is already attached to instances: e5b4f90c-bd24-4e24-9175-7c8bb57f1245 Jul 24 01:16:46.170083 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:46.170083 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 400 to user: Invalid volume: volume 5868751f-c6d5-4175-a7e9-e5457b67fc9b is already attached to instances: e5b4f90c-bd24-4e24-9175-7c8bb57f1245 {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:46.170083 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-fde40501-a805-40bd-a0c6-49ac7ebb7180 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099897 Jul 24 01:16:46.170083 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 297/573] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:16:46 2022] POST /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:16:46.176044 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2746b3bd-0527-4b1b-97b2-1cfb0ef2696c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:46.176536 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2746b3bd-0527-4b1b-97b2-1cfb0ef2696c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:46.183528 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2746b3bd-0527-4b1b-97b2-1cfb0ef2696c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.183974 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2746b3bd-0527-4b1b-97b2-1cfb0ef2696c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.184726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2746b3bd-0527-4b1b-97b2-1cfb0ef2696c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.185156 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2746b3bd-0527-4b1b-97b2-1cfb0ef2696c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.209603 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2746b3bd-0527-4b1b-97b2-1cfb0ef2696c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Going to try to terminate instance {{(pid=118036) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:46.286707 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2746b3bd-0527-4b1b-97b2-1cfb0ef2696c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 204 len: 0 microversion: 2.1 time: 0.114380 Jul 24 01:16:46.287176 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 277/574] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:46 2022] DELETE /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:46.295580 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c8b682d9-575e-479a-863e-b317df308647 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:46.296195 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c8b682d9-575e-479a-863e-b317df308647 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:46.303471 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8b682d9-575e-479a-863e-b317df308647 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.303914 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8b682d9-575e-479a-863e-b317df308647 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.304694 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8b682d9-575e-479a-863e-b317df308647 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.305122 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8b682d9-575e-479a-863e-b317df308647 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.435900 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c8b682d9-575e-479a-863e-b317df308647 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:46.447659 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c8b682d9-575e-479a-863e-b317df308647 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1681 microversion: 2.1 time: 0.155699 Jul 24 01:16:46.448321 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 298/575] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:46 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:46.610246 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b8c845ef-532a-4ca5-b9de-be6f4af58562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:46.610969 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b8c845ef-532a-4ca5-b9de-be6f4af58562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:46.617238 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b8c845ef-532a-4ca5-b9de-be6f4af58562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.617686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b8c845ef-532a-4ca5-b9de-be6f4af58562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.618441 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b8c845ef-532a-4ca5-b9de-be6f4af58562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:46.618877 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b8c845ef-532a-4ca5-b9de-be6f4af58562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:46.749828 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b8c845ef-532a-4ca5-b9de-be6f4af58562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:46.757894 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b8c845ef-532a-4ca5-b9de-be6f4af58562 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.151884 Jul 24 01:16:46.758490 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 278/576] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:46 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:47.470317 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8cdcd3ba-242f-4c7c-bcdb-ad8ae61dc1ec tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:47.471285 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8cdcd3ba-242f-4c7c-bcdb-ad8ae61dc1ec tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:47.481393 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8cdcd3ba-242f-4c7c-bcdb-ad8ae61dc1ec tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:47.481835 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8cdcd3ba-242f-4c7c-bcdb-ad8ae61dc1ec tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:47.482597 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8cdcd3ba-242f-4c7c-bcdb-ad8ae61dc1ec tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:47.483028 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8cdcd3ba-242f-4c7c-bcdb-ad8ae61dc1ec tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:47.777318 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ddf1b864-2c0d-4978-8681-7217ec150a2e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:47.777921 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ddf1b864-2c0d-4978-8681-7217ec150a2e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:47.785839 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddf1b864-2c0d-4978-8681-7217ec150a2e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:47.786452 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddf1b864-2c0d-4978-8681-7217ec150a2e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:47.787502 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddf1b864-2c0d-4978-8681-7217ec150a2e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:47.788144 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddf1b864-2c0d-4978-8681-7217ec150a2e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:47.930924 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8cdcd3ba-242f-4c7c-bcdb-ad8ae61dc1ec tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:47.940317 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8cdcd3ba-242f-4c7c-bcdb-ad8ae61dc1ec tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1681 microversion: 2.1 time: 0.476351 Jul 24 01:16:47.941167 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 299/577] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:47 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1681 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:47.955417 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ddf1b864-2c0d-4978-8681-7217ec150a2e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:47.966365 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ddf1b864-2c0d-4978-8681-7217ec150a2e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.193657 Jul 24 01:16:47.966951 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 279/578] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:47 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:48.958878 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-94c22c23-70fa-45cf-bf0b-039ed717ca90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:48.959597 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-94c22c23-70fa-45cf-bf0b-039ed717ca90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:48.967903 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-94c22c23-70fa-45cf-bf0b-039ed717ca90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:48.968610 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-94c22c23-70fa-45cf-bf0b-039ed717ca90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:48.969781 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-94c22c23-70fa-45cf-bf0b-039ed717ca90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:48.970545 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-94c22c23-70fa-45cf-bf0b-039ed717ca90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:48.984170 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b78f545a-5c56-4342-9f09-1d3c30e7c227 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:48.985455 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b78f545a-5c56-4342-9f09-1d3c30e7c227 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:49.000269 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b78f545a-5c56-4342-9f09-1d3c30e7c227 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:49.003829 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b78f545a-5c56-4342-9f09-1d3c30e7c227 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:49.004811 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b78f545a-5c56-4342-9f09-1d3c30e7c227 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:49.005498 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b78f545a-5c56-4342-9f09-1d3c30e7c227 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:49.180705 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-94c22c23-70fa-45cf-bf0b-039ed717ca90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:49.184591 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b78f545a-5c56-4342-9f09-1d3c30e7c227 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:49.189201 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-94c22c23-70fa-45cf-bf0b-039ed717ca90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1681 microversion: 2.1 time: 0.234531 Jul 24 01:16:49.189894 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 300/579] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:48 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:49.193850 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b78f545a-5c56-4342-9f09-1d3c30e7c227 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.213579 Jul 24 01:16:49.194514 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 280/580] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:48 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:50.210669 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-eafe9c78-4e23-4e34-8161-95911fd96e3b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.211732 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-eafe9c78-4e23-4e34-8161-95911fd96e3b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:50.215367 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-84bd9e2c-f730-4488-b816-5ad824d553ad tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.216728 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-84bd9e2c-f730-4488-b816-5ad824d553ad tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:50.223093 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-eafe9c78-4e23-4e34-8161-95911fd96e3b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.223883 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-eafe9c78-4e23-4e34-8161-95911fd96e3b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.225130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-eafe9c78-4e23-4e34-8161-95911fd96e3b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.225841 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-eafe9c78-4e23-4e34-8161-95911fd96e3b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.227510 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-84bd9e2c-f730-4488-b816-5ad824d553ad tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.228261 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-84bd9e2c-f730-4488-b816-5ad824d553ad tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.229365 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-84bd9e2c-f730-4488-b816-5ad824d553ad tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.229796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-84bd9e2c-f730-4488-b816-5ad824d553ad tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.420898 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-eafe9c78-4e23-4e34-8161-95911fd96e3b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:50.423614 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-84bd9e2c-f730-4488-b816-5ad824d553ad tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:50.428951 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-eafe9c78-4e23-4e34-8161-95911fd96e3b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1681 microversion: 2.1 time: 0.224876 Jul 24 01:16:50.429857 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 301/581] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:50 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:50.432612 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-84bd9e2c-f730-4488-b816-5ad824d553ad tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1734 microversion: 2.1 time: 0.223617 Jul 24 01:16:50.433383 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 281/582] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:50 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:51.268510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-a645f4d5-24ef-429e-94d8-84baef1e4303 req-e1be74af-2a90-4e63-8036-fb5e09d58906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74d4adf-6c79-421f-b475-3eb478eb2124", "name": "network-vif-deleted", "tag": "0cc7ea74-2a38-44cd-bfab-54da31684bd5"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:51.276042 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:51.278237 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-a645f4d5-24ef-429e-94d8-84baef1e4303 req-e1be74af-2a90-4e63-8036-fb5e09d58906 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.278804 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-a645f4d5-24ef-429e-94d8-84baef1e4303 req-e1be74af-2a90-4e63-8036-fb5e09d58906 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.291508 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-a645f4d5-24ef-429e-94d8-84baef1e4303 req-e1be74af-2a90-4e63-8036-fb5e09d58906 service nova] Creating event network-vif-deleted:0cc7ea74-2a38-44cd-bfab-54da31684bd5 for instance c74d4adf-6c79-421f-b475-3eb478eb2124 on hv-cinder-maste Jul 24 01:16:51.296866 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-a645f4d5-24ef-429e-94d8-84baef1e4303 req-e1be74af-2a90-4e63-8036-fb5e09d58906 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031921 Jul 24 01:16:51.297974 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 302/583] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:51.447233 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:51.448660 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:51.452152 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e930dead-bc3e-48a6-87df-3badc0964bfd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:51.452862 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e930dead-bc3e-48a6-87df-3badc0964bfd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:51.456511 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.457257 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.458047 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.458671 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.462068 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e930dead-bc3e-48a6-87df-3badc0964bfd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.462743 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e930dead-bc3e-48a6-87df-3badc0964bfd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.463618 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e930dead-bc3e-48a6-87df-3badc0964bfd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.464221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e930dead-bc3e-48a6-87df-3badc0964bfd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.493116 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.494003 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.495064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lazy-loading 'fault' on Instance uuid c74d4adf-6c79-421f-b475-3eb478eb2124 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:51.563253 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:51.571389 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e7354861-74ad-4317-b622-0c909a84aa51 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 200 len: 1331 microversion: 2.1 time: 0.128985 Jul 24 01:16:51.571957 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 282/584] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:51 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:51.626259 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e930dead-bc3e-48a6-87df-3badc0964bfd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:51.634644 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e930dead-bc3e-48a6-87df-3badc0964bfd tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1714 microversion: 2.1 time: 0.186927 Jul 24 01:16:51.639522 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 303/585] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:51 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1714 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:51.740313 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:51.741105 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:51.747232 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.747770 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.748592 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.749081 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.835227 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] HTTP exception thrown: Cannot 'detach_volume' instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 while it is in vm_state rescued Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Request method failure captured: Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: DELETE /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments/a93f31a1-765a-4766-b47e-6739ec74b9b6 HTTP/1.1 Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxbBq9RVOOhAQ73ZKUuIqeXwuUdZQ3d1dWMBcEkPotAb7wLy9XlKWYf72M40cfFegazXTvNtPJ8Z7wmHfV5zleuIgL43UdUa2qMmm6xuf7JGQq2AZ7GTTqkxHJw3b_LE77Y5xI5GjCIRLWZCBl92MrXAU_Lu8PTGOWaycH1l53LR94 Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:16:51.836860 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55d33269082642989cbc18c052f07b94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55d33269082642989cbc18c052f07b94", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}] Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 1b8154ce6b6b40b4959bf354ccb5c59d Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:16:51.838472 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Cannot 'detach_volume' instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 while it is in vm_state rescued Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'server_id': 'd614ca48-40f2-4927-a2a9-65a14f2fe0a1', 'id': 'a93f31a1-765a-4766-b47e-6739ec74b9b6'} Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:51.839196 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 while it is in vm_state rescued Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 while it is in vm_state rescued Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:16:51.840468 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Returning 409 to user: Cannot 'detach_volume' instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 while it is in vm_state rescued {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:51.841475 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3ecd6c5f-18a9-420a-a275-a4e0acff45c3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments/a93f31a1-765a-4766-b47e-6739ec74b9b6" status: 409 len: 152 microversion: 2.1 time: 0.102010 Jul 24 01:16:51.841475 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 283/586] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:16:51 2022] DELETE /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments/a93f31a1-765a-4766-b47e-6739ec74b9b6 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:16:51.847706 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-884d21c7-b3cf-4e83-9e75-044aa49098c8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:51.848472 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-884d21c7-b3cf-4e83-9e75-044aa49098c8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:51.854671 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-884d21c7-b3cf-4e83-9e75-044aa49098c8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.855116 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-884d21c7-b3cf-4e83-9e75-044aa49098c8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.856245 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-884d21c7-b3cf-4e83-9e75-044aa49098c8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.856372 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-884d21c7-b3cf-4e83-9e75-044aa49098c8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.936448 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-884d21c7-b3cf-4e83-9e75-044aa49098c8 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "POST /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/action" status: 202 len: 0 microversion: 2.1 time: 0.092611 Jul 24 01:16:51.937598 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 304/587] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:51 2022] POST /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:51.946979 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-34858dac-0976-4b79-a289-d7b49c51fd2c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:51.947884 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-34858dac-0976-4b79-a289-d7b49c51fd2c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:51.957297 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-34858dac-0976-4b79-a289-d7b49c51fd2c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.957766 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-34858dac-0976-4b79-a289-d7b49c51fd2c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.958998 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-34858dac-0976-4b79-a289-d7b49c51fd2c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.959093 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-34858dac-0976-4b79-a289-d7b49c51fd2c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.109328 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-34858dac-0976-4b79-a289-d7b49c51fd2c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:52.117595 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-34858dac-0976-4b79-a289-d7b49c51fd2c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1722 microversion: 2.1 time: 0.175819 Jul 24 01:16:52.118468 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 284/588] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:51 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:52.589339 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:52.590036 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:52.597212 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.597654 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.598421 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.598845 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.612685 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 HTTP/1.1 Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:16:52.614417 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:16:52.616061 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': 'c74d4adf-6c79-421f-b475-3eb478eb2124'} Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:52.616919 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:16:52.618332 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.619994 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:52.619994 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-09a8b8d9-a522-48d7-9354-95029305c1db tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 404 len: 111 microversion: 2.1 time: 0.030770 Jul 24 01:16:52.619994 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 305/589] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:52 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:52.625052 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b47bc93b-1c86-486d-ab3a-23049fa1a3b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '.version_select at 0x7fdf3c2181f0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:52.646330 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b47bc93b-1c86-486d-ab3a-23049fa1a3b7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152461608" status: 202 len: 0 microversion: 2.1 time: 0.025095 Jul 24 01:16:52.646881 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 285/590] 10.222.0.42 () {58 vars in 1220 bytes} [Sun Jul 24 01:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152461608 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:16:53.135675 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0d10b95c-b722-4eb2-98c0-4c96848bf20d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:53.136581 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0d10b95c-b722-4eb2-98c0-4c96848bf20d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:53.143103 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0d10b95c-b722-4eb2-98c0-4c96848bf20d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.143855 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0d10b95c-b722-4eb2-98c0-4c96848bf20d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.144657 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0d10b95c-b722-4eb2-98c0-4c96848bf20d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.145099 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0d10b95c-b722-4eb2-98c0-4c96848bf20d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.161815 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:53.323452 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0d10b95c-b722-4eb2-98c0-4c96848bf20d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:53.324191 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-833629b7-f80f-4b53-a389-c3a707d13b49 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:53.325015 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-833629b7-f80f-4b53-a389-c3a707d13b49 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:53.331758 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-833629b7-f80f-4b53-a389-c3a707d13b49 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.332036 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0d10b95c-b722-4eb2-98c0-4c96848bf20d tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1722 microversion: 2.1 time: 0.200484 Jul 24 01:16:53.332574 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 306/591] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:53 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:53.333023 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-833629b7-f80f-4b53-a389-c3a707d13b49 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.333919 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-833629b7-f80f-4b53-a389-c3a707d13b49 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.334362 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-833629b7-f80f-4b53-a389-c3a707d13b49 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.414270 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-833629b7-f80f-4b53-a389-c3a707d13b49 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lazy-loading 'services' on Instance uuid e5b4f90c-bd24-4e24-9175-7c8bb57f1245 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:53.492046 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-833629b7-f80f-4b53-a389-c3a707d13b49 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments/5868751f-c6d5-4175-a7e9-e5457b67fc9b" status: 202 len: 0 microversion: 2.1 time: 0.172296 Jul 24 01:16:53.492651 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 286/592] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:16:53 2022] DELETE /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments/5868751f-c6d5-4175-a7e9-e5457b67fc9b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:53.501311 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-516deb07-dbae-4364-888b-160d794465df tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:53.502414 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-516deb07-dbae-4364-888b-160d794465df tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:53.508762 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-516deb07-dbae-4364-888b-160d794465df tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.509289 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-516deb07-dbae-4364-888b-160d794465df tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.510186 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-516deb07-dbae-4364-888b-160d794465df tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.510725 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-516deb07-dbae-4364-888b-160d794465df tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.539570 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-516deb07-dbae-4364-888b-160d794465df tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Jul 24 01:16:53.540116 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 307/593] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:16:53 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:54.355362 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-81ec6645-5846-48b5-b2a0-f75de57bcc19 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:54.356429 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-81ec6645-5846-48b5-b2a0-f75de57bcc19 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:54.367214 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81ec6645-5846-48b5-b2a0-f75de57bcc19 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.368017 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81ec6645-5846-48b5-b2a0-f75de57bcc19 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.369336 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81ec6645-5846-48b5-b2a0-f75de57bcc19 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.370064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81ec6645-5846-48b5-b2a0-f75de57bcc19 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.505156 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-81ec6645-5846-48b5-b2a0-f75de57bcc19 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:54.513566 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-81ec6645-5846-48b5-b2a0-f75de57bcc19 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1722 microversion: 2.1 time: 0.166317 Jul 24 01:16:54.514132 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 287/594] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:54 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:54.551946 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8065bcf6-0d46-489a-99a7-40f57c087079 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:54.552866 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8065bcf6-0d46-489a-99a7-40f57c087079 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:54.559587 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8065bcf6-0d46-489a-99a7-40f57c087079 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.560035 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8065bcf6-0d46-489a-99a7-40f57c087079 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.560787 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8065bcf6-0d46-489a-99a7-40f57c087079 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.561212 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8065bcf6-0d46-489a-99a7-40f57c087079 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.590360 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8065bcf6-0d46-489a-99a7-40f57c087079 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 Jul 24 01:16:54.590921 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 308/595] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:16:54 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:55.534461 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7621ac45-9d97-45df-9393-b85fec4b15a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:55.536804 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7621ac45-9d97-45df-9393-b85fec4b15a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:55.548070 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7621ac45-9d97-45df-9393-b85fec4b15a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.548294 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7621ac45-9d97-45df-9393-b85fec4b15a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.549121 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7621ac45-9d97-45df-9393-b85fec4b15a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.549977 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7621ac45-9d97-45df-9393-b85fec4b15a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.683949 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7621ac45-9d97-45df-9393-b85fec4b15a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:55.692417 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7621ac45-9d97-45df-9393-b85fec4b15a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1722 microversion: 2.1 time: 0.164397 Jul 24 01:16:55.693249 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 288/596] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:55 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:55.776425 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-cf31a55c-c92d-4563-84d1-0d2085830b1c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:55.777697 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-cf31a55c-c92d-4563-84d1-0d2085830b1c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:55.784022 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cf31a55c-c92d-4563-84d1-0d2085830b1c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.784529 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cf31a55c-c92d-4563-84d1-0d2085830b1c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.785266 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cf31a55c-c92d-4563-84d1-0d2085830b1c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.785688 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cf31a55c-c92d-4563-84d1-0d2085830b1c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.816034 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-cf31a55c-c92d-4563-84d1-0d2085830b1c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217592 Jul 24 01:16:55.816589 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 309/597] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:16:55 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:16:56.766518 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2aa9654c-aef0-4ad4-843b-1807dcd2cdd0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:56.767135 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2aa9654c-aef0-4ad4-843b-1807dcd2cdd0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:56.773444 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2aa9654c-aef0-4ad4-843b-1807dcd2cdd0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.773895 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2aa9654c-aef0-4ad4-843b-1807dcd2cdd0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.774651 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2aa9654c-aef0-4ad4-843b-1807dcd2cdd0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.775086 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2aa9654c-aef0-4ad4-843b-1807dcd2cdd0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.827983 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7097729b-c452-4634-9da8-9b0811a7eaf9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:56.828944 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7097729b-c452-4634-9da8-9b0811a7eaf9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:56.835644 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7097729b-c452-4634-9da8-9b0811a7eaf9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.836095 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7097729b-c452-4634-9da8-9b0811a7eaf9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.836858 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7097729b-c452-4634-9da8-9b0811a7eaf9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.837293 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7097729b-c452-4634-9da8-9b0811a7eaf9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.866289 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7097729b-c452-4634-9da8-9b0811a7eaf9 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042330 Jul 24 01:16:56.867048 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 310/598] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:16:56 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:16:56.907673 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2aa9654c-aef0-4ad4-843b-1807dcd2cdd0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:56.915780 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2aa9654c-aef0-4ad4-843b-1807dcd2cdd0 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1728 microversion: 2.1 time: 0.209939 Jul 24 01:16:56.916316 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 289/599] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:56 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:56.924063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0254b45d-c886-4c31-b53f-e636bd5c162f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:56.924911 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0254b45d-c886-4c31-b53f-e636bd5c162f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:56.930953 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0254b45d-c886-4c31-b53f-e636bd5c162f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.931422 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0254b45d-c886-4c31-b53f-e636bd5c162f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.932024 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-472a5877-b53d-4ee4-846e-98b492d0d6ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:56.932177 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0254b45d-c886-4c31-b53f-e636bd5c162f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.932505 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-472a5877-b53d-4ee4-846e-98b492d0d6ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:56.932614 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0254b45d-c886-4c31-b53f-e636bd5c162f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.938433 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-472a5877-b53d-4ee4-846e-98b492d0d6ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.938874 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-472a5877-b53d-4ee4-846e-98b492d0d6ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.939653 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-472a5877-b53d-4ee4-846e-98b492d0d6ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.940079 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-472a5877-b53d-4ee4-846e-98b492d0d6ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.953585 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:56.956933 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0254b45d-c886-4c31-b53f-e636bd5c162f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:57.019340 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-472a5877-b53d-4ee4-846e-98b492d0d6ce tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090704 Jul 24 01:16:57.019977 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 290/600] 10.222.0.42 () {58 vars in 1274 bytes} [Sun Jul 24 01:16:56 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:57.040331 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0254b45d-c886-4c31-b53f-e636bd5c162f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 204 len: 0 microversion: 2.1 time: 0.119664 Jul 24 01:16:57.041337 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 311/601] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:56 2022] DELETE /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:16:57.049962 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1b022f21-cbd1-49e2-bbe4-4a180ff30eed tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:57.050811 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1b022f21-cbd1-49e2-bbe4-4a180ff30eed tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:57.057115 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1b022f21-cbd1-49e2-bbe4-4a180ff30eed tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.057558 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1b022f21-cbd1-49e2-bbe4-4a180ff30eed tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.058302 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1b022f21-cbd1-49e2-bbe4-4a180ff30eed tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.058762 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1b022f21-cbd1-49e2-bbe4-4a180ff30eed tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.280901 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1b022f21-cbd1-49e2-bbe4-4a180ff30eed tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:57.289625 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1b022f21-cbd1-49e2-bbe4-4a180ff30eed tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1681 microversion: 2.1 time: 0.243785 Jul 24 01:16:57.290194 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 291/602] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:57 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:57.972952 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-df5c4788-ad16-4e0d-8813-28d359750a16 req-35bc9b40-d164-40fb-8a03-36ed894b8b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d614ca48-40f2-4927-a2a9-65a14f2fe0a1", "tag": "f6ef1157-8359-4903-8874-ba4b3c99bee5"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:57.982343 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-df5c4788-ad16-4e0d-8813-28d359750a16 req-35bc9b40-d164-40fb-8a03-36ed894b8b3a service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.982975 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-df5c4788-ad16-4e0d-8813-28d359750a16 req-35bc9b40-d164-40fb-8a03-36ed894b8b3a service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.996637 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-df5c4788-ad16-4e0d-8813-28d359750a16 req-35bc9b40-d164-40fb-8a03-36ed894b8b3a service nova] Creating event network-changed:f6ef1157-8359-4903-8874-ba4b3c99bee5 for instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 on hv-cinder-maste Jul 24 01:16:58.002450 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-df5c4788-ad16-4e0d-8813-28d359750a16 req-35bc9b40-d164-40fb-8a03-36ed894b8b3a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033567 Jul 24 01:16:58.003057 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 312/603] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:58.307780 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-497c867a-33b8-42ed-9264-449b6e725aa8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:58.308386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-497c867a-33b8-42ed-9264-449b6e725aa8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:58.314742 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-497c867a-33b8-42ed-9264-449b6e725aa8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:58.315185 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-497c867a-33b8-42ed-9264-449b6e725aa8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:58.315968 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-497c867a-33b8-42ed-9264-449b6e725aa8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:58.316391 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-497c867a-33b8-42ed-9264-449b6e725aa8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:58.444181 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-497c867a-33b8-42ed-9264-449b6e725aa8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:58.451698 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-497c867a-33b8-42ed-9264-449b6e725aa8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1681 microversion: 2.1 time: 0.148010 Jul 24 01:16:58.452271 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 292/604] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:58 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:59.468704 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-34236e08-c0ba-4a2d-a227-dd83aee97985 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:59.469411 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-34236e08-c0ba-4a2d-a227-dd83aee97985 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:59.476562 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-34236e08-c0ba-4a2d-a227-dd83aee97985 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.476930 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-34236e08-c0ba-4a2d-a227-dd83aee97985 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.477683 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-34236e08-c0ba-4a2d-a227-dd83aee97985 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.478112 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-34236e08-c0ba-4a2d-a227-dd83aee97985 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.708929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-34236e08-c0ba-4a2d-a227-dd83aee97985 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:59.717101 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-34236e08-c0ba-4a2d-a227-dd83aee97985 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1681 microversion: 2.1 time: 0.252653 Jul 24 01:16:59.717637 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 313/605] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:59 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1681 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:00.191481 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-cfad4306-7d21-4302-a7a7-0e4ddb7e2c56 req-dad139ff-8015-4e8b-8cc6-e9cc44f20ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d614ca48-40f2-4927-a2a9-65a14f2fe0a1", "tag": "f6ef1157-8359-4903-8874-ba4b3c99bee5"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:00.201013 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-cfad4306-7d21-4302-a7a7-0e4ddb7e2c56 req-dad139ff-8015-4e8b-8cc6-e9cc44f20ef2 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.201454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-cfad4306-7d21-4302-a7a7-0e4ddb7e2c56 req-dad139ff-8015-4e8b-8cc6-e9cc44f20ef2 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.213541 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-cfad4306-7d21-4302-a7a7-0e4ddb7e2c56 req-dad139ff-8015-4e8b-8cc6-e9cc44f20ef2 service nova] Creating event network-changed:f6ef1157-8359-4903-8874-ba4b3c99bee5 for instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 on hv-cinder-maste Jul 24 01:17:00.219516 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-cfad4306-7d21-4302-a7a7-0e4ddb7e2c56 req-dad139ff-8015-4e8b-8cc6-e9cc44f20ef2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032810 Jul 24 01:17:00.220755 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 293/606] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:00.734315 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:00.734889 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:00.742149 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.742597 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.743353 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.743817 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.774432 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.774841 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.775323 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lazy-loading 'fault' on Instance uuid e5b4f90c-bd24-4e24-9175-7c8bb57f1245 {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:17:00.819125 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:00.826958 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1aec9060-0ec1-48b2-8884-e7d4e6832866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 200 len: 1331 microversion: 2.1 time: 0.096574 Jul 24 01:17:00.827570 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 314/607] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:00 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:00.904769 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:17:00.904988 dv-cinder-master-3-smb devstack@n-api.service[118036]: Sun Jul 24 01:17:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:17:01.846064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:01.846778 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:01.854059 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.854500 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.855253 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.855733 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.868940 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 HTTP/1.1 Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:17:01.870540 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:17:01.872258 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'e5b4f90c-bd24-4e24-9175-7c8bb57f1245'} Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:01.873100 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:17:01.874440 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.875720 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:01.875720 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-add385ea-cd8c-4b6a-8af6-5e89c0c9cd53 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 404 len: 111 microversion: 2.1 time: 0.030225 Jul 24 01:17:01.875720 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 294/608] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:01 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:01.883597 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f90aea1a-4dc6-492d-a20c-344c9ec55be5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '.version_select at 0x7fdf3c164ca0>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:01.908006 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f90aea1a-4dc6-492d-a20c-344c9ec55be5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-484873425" status: 202 len: 0 microversion: 2.1 time: 0.030329 Jul 24 01:17:01.908574 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 315/609] 10.222.0.42 () {58 vars in 1217 bytes} [Sun Jul 24 01:17:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-484873425 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:02.254948 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-425371e9-8691-480b-b304-8699c73474cc req-d66d808e-b6c6-41c7-a213-4a676d977170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b4f90c-bd24-4e24-9175-7c8bb57f1245", "name": "network-vif-deleted", "tag": "10d1484e-6736-4cd1-a0dd-fea4d4375bbc"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:02.263232 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-425371e9-8691-480b-b304-8699c73474cc req-d66d808e-b6c6-41c7-a213-4a676d977170 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:02.263709 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-425371e9-8691-480b-b304-8699c73474cc req-d66d808e-b6c6-41c7-a213-4a676d977170 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:02.274990 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-425371e9-8691-480b-b304-8699c73474cc req-d66d808e-b6c6-41c7-a213-4a676d977170 service nova] Creating event network-vif-deleted:10d1484e-6736-4cd1-a0dd-fea4d4375bbc for instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 on hv-cinder-maste Jul 24 01:17:02.279937 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-425371e9-8691-480b-b304-8699c73474cc req-d66d808e-b6c6-41c7-a213-4a676d977170 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028991 Jul 24 01:17:02.280733 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 295/610] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:02.510912 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-397a9221-12ef-4f03-acff-8c3cbb930221 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: .version_select at 0x7fdf3c025160>, body: {"keypair": {"name": "tempest-keypair-936792505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPINgSwl30SONMXmynelezfkHGFkJuMp573i5Zjtyu1rHWqey7T8+dqJ7fdtbslPHrxljbD15BjsbadIHUNq6mYhscNNTlAuVkAxhnJLvSN/zcPtwVcJJQA/Ws6bmAZiJg=="}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:02.526057 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-397a9221-12ef-4f03-acff-8c3cbb930221 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:02.530426 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-397a9221-12ef-4f03-acff-8c3cbb930221 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for user 1e7d0f401530454ba0cae0f5e9d6e0ce and project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:02.555868 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-397a9221-12ef-4f03-acff-8c3cbb930221 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049177 Jul 24 01:17:02.556444 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 316/611] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:04.034336 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-01ae6bd2-1f3d-4a84-b96e-bc820c698d83 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-710219624"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:04.036154 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-01ae6bd2-1f3d-4a84-b96e-bc820c698d83 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:04.043698 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-01ae6bd2-1f3d-4a84-b96e-bc820c698d83 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:04.044304 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-01ae6bd2-1f3d-4a84-b96e-bc820c698d83 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:04.045548 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-01ae6bd2-1f3d-4a84-b96e-bc820c698d83 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:04.046121 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-01ae6bd2-1f3d-4a84-b96e-bc820c698d83 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:04.077510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-281917775", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcbaf71d-4a65-44d0-a781-ad7ed5a13863"}], "security_groups": [{"name": "tempest-securitygroup--960565142"}], "key_name": "tempest-keypair-936792505", "user_data": "}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:04.208302 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.network.security_group_api [None req-01ae6bd2-1f3d-4a84-b96e-bc820c698d83 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Removing security group 0c29fac0-945e-4a3d-8fcd-9e732c6aac13 from port d7404b6e-b96a-4369-8b9a-a904feefadaa Jul 24 01:17:04.215146 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.network.neutron [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] validate_networks() for [('fcbaf71d-4a65-44d0-a781-ad7ed5a13863', None, None, None, None, None)] {{(pid=118035) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:17:04.755626 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-01ae6bd2-1f3d-4a84-b96e-bc820c698d83 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "POST /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/action" status: 202 len: 0 microversion: 2.1 time: 0.729375 Jul 24 01:17:04.759382 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 296/612] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:17:04 2022] POST /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/action => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:04.764544 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-6da7eae3-b213-40ac-9864-3e96299cd22a req-83ddde7c-c5f9-4521-b2dd-1448ecb7a113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f1a40f-b6a7-433a-8a0a-83126081a557", "tag": "d7404b6e-b96a-4369-8b9a-a904feefadaa"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:04.775251 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-6da7eae3-b213-40ac-9864-3e96299cd22a req-83ddde7c-c5f9-4521-b2dd-1448ecb7a113 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:04.775975 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-6da7eae3-b213-40ac-9864-3e96299cd22a req-83ddde7c-c5f9-4521-b2dd-1448ecb7a113 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:04.792968 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-6da7eae3-b213-40ac-9864-3e96299cd22a req-83ddde7c-c5f9-4521-b2dd-1448ecb7a113 service nova] Creating event network-changed:d7404b6e-b96a-4369-8b9a-a904feefadaa for instance d1f1a40f-b6a7-433a-8a0a-83126081a557 on hv-cinder-maste Jul 24 01:17:04.804328 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-6da7eae3-b213-40ac-9864-3e96299cd22a req-83ddde7c-c5f9-4521-b2dd-1448ecb7a113 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043458 Jul 24 01:17:04.805297 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 297/613] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:04.949947 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Flavor limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:17:04.950377 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Image limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:17:04.951019 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Flavor pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:17:04.951467 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Image pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:17:04.951884 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:17:04.961878 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:04.962610 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:04.963604 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:04.964238 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:04.988289 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:04.993726 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for user 1e7d0f401530454ba0cae0f5e9d6e0ce and project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:05.006942 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Going to run 1 instances... {{(pid=118035) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:17:05.009293 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118035) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:17:05.089916 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-efd750ad-04cf-48c6-9e65-2e1967850e95 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.017059 Jul 24 01:17:05.090593 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 317/614] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:17:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:17:05.111510 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5ea22d52-383c-4560-90f0-ed34f989c157 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:05.113194 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5ea22d52-383c-4560-90f0-ed34f989c157 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:05.208676 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5ea22d52-383c-4560-90f0-ed34f989c157 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:05.215910 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5ea22d52-383c-4560-90f0-ed34f989c157 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1240 microversion: 2.1 time: 0.118330 Jul 24 01:17:05.218698 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 298/615] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:05 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:06.019909 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2b4ee690-929d-44d4-8c00-7862dbcc8d2f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:06.020413 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-2b4ee690-929d-44d4-8c00-7862dbcc8d2f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:06.026993 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2b4ee690-929d-44d4-8c00-7862dbcc8d2f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.027503 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2b4ee690-929d-44d4-8c00-7862dbcc8d2f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.028275 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2b4ee690-929d-44d4-8c00-7862dbcc8d2f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.028805 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2b4ee690-929d-44d4-8c00-7862dbcc8d2f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.109975 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-2b4ee690-929d-44d4-8c00-7862dbcc8d2f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lazy-loading 'services' on Instance uuid d1f1a40f-b6a7-433a-8a0a-83126081a557 {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:17:06.186518 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2b4ee690-929d-44d4-8c00-7862dbcc8d2f tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments/93281ab6-e676-4c4f-9652-ef0ebb7f71fd" status: 202 len: 0 microversion: 2.1 time: 0.170508 Jul 24 01:17:06.187691 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 318/616] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:17:06 2022] DELETE /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments/93281ab6-e676-4c4f-9652-ef0ebb7f71fd => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:17:06.196459 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-47240f97-da80-45b2-8fe8-98fc14387e88 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:06.197409 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-47240f97-da80-45b2-8fe8-98fc14387e88 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:06.205379 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-47240f97-da80-45b2-8fe8-98fc14387e88 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.206125 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-47240f97-da80-45b2-8fe8-98fc14387e88 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.207071 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-47240f97-da80-45b2-8fe8-98fc14387e88 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.207697 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-47240f97-da80-45b2-8fe8-98fc14387e88 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.235810 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d048dd1a-7cc5-4d08-bfc7-3247cc6bcf8d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:06.236899 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d048dd1a-7cc5-4d08-bfc7-3247cc6bcf8d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:06.245647 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d048dd1a-7cc5-4d08-bfc7-3247cc6bcf8d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.246584 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d048dd1a-7cc5-4d08-bfc7-3247cc6bcf8d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.247734 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d048dd1a-7cc5-4d08-bfc7-3247cc6bcf8d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.248445 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d048dd1a-7cc5-4d08-bfc7-3247cc6bcf8d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.263901 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-47240f97-da80-45b2-8fe8-98fc14387e88 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071280 Jul 24 01:17:06.264487 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 299/617] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:17:06 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:06.325965 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d048dd1a-7cc5-4d08-bfc7-3247cc6bcf8d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:06.333683 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d048dd1a-7cc5-4d08-bfc7-3247cc6bcf8d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1292 microversion: 2.1 time: 0.102669 Jul 24 01:17:06.340180 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 319/618] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:06 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:06.825172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-0392ee3c-8892-460d-a823-4c76d0952418 req-81008923-9cc0-49cc-b9cc-263507a11310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f1a40f-b6a7-433a-8a0a-83126081a557", "tag": "d7404b6e-b96a-4369-8b9a-a904feefadaa"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:06.834005 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0392ee3c-8892-460d-a823-4c76d0952418 req-81008923-9cc0-49cc-b9cc-263507a11310 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.834444 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0392ee3c-8892-460d-a823-4c76d0952418 req-81008923-9cc0-49cc-b9cc-263507a11310 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.846426 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-0392ee3c-8892-460d-a823-4c76d0952418 req-81008923-9cc0-49cc-b9cc-263507a11310 service nova] Creating event network-changed:d7404b6e-b96a-4369-8b9a-a904feefadaa for instance d1f1a40f-b6a7-433a-8a0a-83126081a557 on hv-cinder-maste Jul 24 01:17:06.852541 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-0392ee3c-8892-460d-a823-4c76d0952418 req-81008923-9cc0-49cc-b9cc-263507a11310 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030929 Jul 24 01:17:06.853215 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 300/619] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:07.276040 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-84e3fde0-77c9-4fb9-9c5a-ff4b3d746546 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.277757 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-84e3fde0-77c9-4fb9-9c5a-ff4b3d746546 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:07.285054 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-84e3fde0-77c9-4fb9-9c5a-ff4b3d746546 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:07.285496 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-84e3fde0-77c9-4fb9-9c5a-ff4b3d746546 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:07.286466 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-84e3fde0-77c9-4fb9-9c5a-ff4b3d746546 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:07.287183 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-84e3fde0-77c9-4fb9-9c5a-ff4b3d746546 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:07.321674 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-84e3fde0-77c9-4fb9-9c5a-ff4b3d746546 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049608 Jul 24 01:17:07.322574 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 320/620] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:17:07 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:07.352800 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0b40d6ab-b1fa-4122-a453-19a82de36544 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.354460 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0b40d6ab-b1fa-4122-a453-19a82de36544 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:07.363417 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b40d6ab-b1fa-4122-a453-19a82de36544 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:07.364594 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b40d6ab-b1fa-4122-a453-19a82de36544 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:07.365721 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b40d6ab-b1fa-4122-a453-19a82de36544 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:07.366686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b40d6ab-b1fa-4122-a453-19a82de36544 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:07.603157 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-0b40d6ab-b1fa-4122-a453-19a82de36544 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:07.611217 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0b40d6ab-b1fa-4122-a453-19a82de36544 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1365 microversion: 2.1 time: 0.264142 Jul 24 01:17:07.611884 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 301/621] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:07 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:08.185267 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-86d9f2e9-8c57-4241-8331-0515da1bd2f3 req-83964da3-e37a-409c-b309-acb15cb2e906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0506b1-88fd-49f6-a2f5-88288c722940", "tag": "1ab3d91c-9b3a-47af-b569-49fa8cc163f2"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:08.196849 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-86d9f2e9-8c57-4241-8331-0515da1bd2f3 req-83964da3-e37a-409c-b309-acb15cb2e906 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.197380 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-86d9f2e9-8c57-4241-8331-0515da1bd2f3 req-83964da3-e37a-409c-b309-acb15cb2e906 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.209446 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-86d9f2e9-8c57-4241-8331-0515da1bd2f3 req-83964da3-e37a-409c-b309-acb15cb2e906 service nova] Creating event network-changed:1ab3d91c-9b3a-47af-b569-49fa8cc163f2 for instance dc0506b1-88fd-49f6-a2f5-88288c722940 on hv-cinder-maste Jul 24 01:17:08.219008 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-86d9f2e9-8c57-4241-8331-0515da1bd2f3 req-83964da3-e37a-409c-b309-acb15cb2e906 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042419 Jul 24 01:17:08.219973 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 321/622] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:08.334042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c74d833d-0b24-4c8e-b09e-72ed5cc3f346 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:08.334982 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c74d833d-0b24-4c8e-b09e-72ed5cc3f346 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:08.343507 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c74d833d-0b24-4c8e-b09e-72ed5cc3f346 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.343848 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c74d833d-0b24-4c8e-b09e-72ed5cc3f346 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.344608 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c74d833d-0b24-4c8e-b09e-72ed5cc3f346 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.345027 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c74d833d-0b24-4c8e-b09e-72ed5cc3f346 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.373385 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c74d833d-0b24-4c8e-b09e-72ed5cc3f346 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043246 Jul 24 01:17:08.374052 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 302/623] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:17:08 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:17:08.385048 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:08.385717 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:08.392398 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.392877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.393646 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.394088 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.473126 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] HTTP exception thrown: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 is not attached to volume 93281ab6-e676-4c4f-9652-ef0ebb7f71fd Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Request method failure captured: Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: DELETE /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments/93281ab6-e676-4c4f-9652-ef0ebb7f71fd HTTP/1.1 Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JybMzT5Zh1vIS4hQ8CrvJBM6HyAl69H7IdGr1j4nz_wVSXq6ijqZRZszqUMhbGDrtpeK-odNg-LLuvk2z2OW_9827WridlRiFBFeMuTUvnPS_TsoNex2btAjC6kUlqYTgz2Tp7uTx8NHcd14RPSqHBAbxn3rf06uo3R93N_vfZz4Zw Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 083e6e1f36c3453da2befa06a4875014 Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-TestMinimumBasicScenario-846245326 Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:17:08.475618 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/083e6e1f36c3453da2befa06a4875014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_083e6e1f36c3453da2befa06a4875014", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/083e6e1f36c3453da2befa06a4875014"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/083e6e1f36c3453da2befa06a4875014"}]}] Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-TestMinimumBasicScenario-846245326 Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 083e6e1f36c3453da2befa06a4875014 Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-TestMinimumBasicScenario-846245326 Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-TestMinimumBasicScenario-846245326-project Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 9a0398a0ec144dfcbcc4c92fc54d4dee Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-TestMinimumBasicScenario-846245326-project Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:17:08.477185 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 is not attached to volume 93281ab6-e676-4c4f-9652-ef0ebb7f71fd Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'server_id': 'd1f1a40f-b6a7-433a-8a0a-83126081a557', 'id': '93281ab6-e676-4c4f-9652-ef0ebb7f71fd'} Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 93281ab6-e676-4c4f-9652-ef0ebb7f71fd. Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:08.478082 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 is not attached to volume 93281ab6-e676-4c4f-9652-ef0ebb7f71fd Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 is not attached to volume 93281ab6-e676-4c4f-9652-ef0ebb7f71fd Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:08.479503 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Returning 404 to user: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 is not attached to volume 93281ab6-e676-4c4f-9652-ef0ebb7f71fd {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:08.480626 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-31646498-67a5-4507-b690-dc70f5f9c6f7 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments/93281ab6-e676-4c4f-9652-ef0ebb7f71fd" status: 404 len: 154 microversion: 2.1 time: 0.097057 Jul 24 01:17:08.480626 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 322/624] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:17:08 2022] DELETE /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557/os-volume_attachments/93281ab6-e676-4c4f-9652-ef0ebb7f71fd => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:08.630274 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-477f5145-978a-45c0-99d7-7faba554ef21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:08.631157 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-477f5145-978a-45c0-99d7-7faba554ef21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:08.640235 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-477f5145-978a-45c0-99d7-7faba554ef21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.640820 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-477f5145-978a-45c0-99d7-7faba554ef21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.641584 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-477f5145-978a-45c0-99d7-7faba554ef21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.642007 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-477f5145-978a-45c0-99d7-7faba554ef21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.772468 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-477f5145-978a-45c0-99d7-7faba554ef21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:08.780609 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-477f5145-978a-45c0-99d7-7faba554ef21 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1365 microversion: 2.1 time: 0.155234 Jul 24 01:17:08.781190 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 303/625] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:08 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:09.633431 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c8dbacb9-0d0c-4318-b72a-e440b0acfabd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:09.634116 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c8dbacb9-0d0c-4318-b72a-e440b0acfabd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:09.641924 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8dbacb9-0d0c-4318-b72a-e440b0acfabd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.642374 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8dbacb9-0d0c-4318-b72a-e440b0acfabd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.643132 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8dbacb9-0d0c-4318-b72a-e440b0acfabd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.643608 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c8dbacb9-0d0c-4318-b72a-e440b0acfabd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.668785 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c8dbacb9-0d0c-4318-b72a-e440b0acfabd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:09.692328 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:09.753368 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c8dbacb9-0d0c-4318-b72a-e440b0acfabd tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 204 len: 0 microversion: 2.1 time: 0.125935 Jul 24 01:17:09.753937 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 323/626] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:09 2022] DELETE /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:09.762287 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f4ea7733-4930-4f4c-99b1-b1500ad35952 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:09.762904 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f4ea7733-4930-4f4c-99b1-b1500ad35952 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:09.769503 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f4ea7733-4930-4f4c-99b1-b1500ad35952 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.769951 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f4ea7733-4930-4f4c-99b1-b1500ad35952 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.770723 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f4ea7733-4930-4f4c-99b1-b1500ad35952 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.771152 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f4ea7733-4930-4f4c-99b1-b1500ad35952 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.798092 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-42f86652-53d9-414f-aa24-9d5ac7b34a3e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:09.799436 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-42f86652-53d9-414f-aa24-9d5ac7b34a3e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:09.807051 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-42f86652-53d9-414f-aa24-9d5ac7b34a3e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.807515 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-42f86652-53d9-414f-aa24-9d5ac7b34a3e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.808522 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-42f86652-53d9-414f-aa24-9d5ac7b34a3e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.808976 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-42f86652-53d9-414f-aa24-9d5ac7b34a3e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.950918 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f4ea7733-4930-4f4c-99b1-b1500ad35952 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:09.959239 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f4ea7733-4930-4f4c-99b1-b1500ad35952 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1555 microversion: 2.1 time: 0.200787 Jul 24 01:17:09.959908 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 304/627] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:09 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:09.981697 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-42f86652-53d9-414f-aa24-9d5ac7b34a3e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:09.992877 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-42f86652-53d9-414f-aa24-9d5ac7b34a3e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1365 microversion: 2.1 time: 0.198755 Jul 24 01:17:09.993765 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 324/628] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:09 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:10.982209 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-76c7c5df-c9c8-45de-bc9e-abc50273999d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:10.983351 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-76c7c5df-c9c8-45de-bc9e-abc50273999d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:10.994346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-76c7c5df-c9c8-45de-bc9e-abc50273999d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.995147 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-76c7c5df-c9c8-45de-bc9e-abc50273999d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.996442 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-76c7c5df-c9c8-45de-bc9e-abc50273999d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.997235 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-76c7c5df-c9c8-45de-bc9e-abc50273999d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.010438 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-17afa599-6085-4931-9aaf-c1e620653af6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:11.011044 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-17afa599-6085-4931-9aaf-c1e620653af6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:11.018257 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-17afa599-6085-4931-9aaf-c1e620653af6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.018704 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-17afa599-6085-4931-9aaf-c1e620653af6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.019502 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-17afa599-6085-4931-9aaf-c1e620653af6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.019929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-17afa599-6085-4931-9aaf-c1e620653af6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.191446 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-76c7c5df-c9c8-45de-bc9e-abc50273999d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:11.194741 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-17afa599-6085-4931-9aaf-c1e620653af6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:11.199105 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-76c7c5df-c9c8-45de-bc9e-abc50273999d tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1555 microversion: 2.1 time: 0.223479 Jul 24 01:17:11.199670 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 305/629] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:10 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:11.202485 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-17afa599-6085-4931-9aaf-c1e620653af6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1365 microversion: 2.1 time: 0.196169 Jul 24 01:17:11.203043 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 325/630] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:11 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:12.223940 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-99737a41-de7d-4d91-8d99-5e4a0212e690 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:12.224887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0d80ec64-0485-40a3-b4f0-0887cc84dbed tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:12.225457 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0d80ec64-0485-40a3-b4f0-0887cc84dbed tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:12.226934 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-99737a41-de7d-4d91-8d99-5e4a0212e690 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:12.229345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:12.235669 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d80ec64-0485-40a3-b4f0-0887cc84dbed tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:12.236119 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d80ec64-0485-40a3-b4f0-0887cc84dbed tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:12.236229 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-99737a41-de7d-4d91-8d99-5e4a0212e690 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:12.236696 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-99737a41-de7d-4d91-8d99-5e4a0212e690 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:12.236888 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d80ec64-0485-40a3-b4f0-0887cc84dbed tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:12.237327 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d80ec64-0485-40a3-b4f0-0887cc84dbed tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:12.237635 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-99737a41-de7d-4d91-8d99-5e4a0212e690 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:12.238176 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-99737a41-de7d-4d91-8d99-5e4a0212e690 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:12.437668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-0d80ec64-0485-40a3-b4f0-0887cc84dbed tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:12.441626 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-99737a41-de7d-4d91-8d99-5e4a0212e690 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:12.445385 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0d80ec64-0485-40a3-b4f0-0887cc84dbed tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1555 microversion: 2.1 time: 0.228869 Jul 24 01:17:12.445954 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 306/631] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:12 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:12.453531 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-99737a41-de7d-4d91-8d99-5e4a0212e690 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1365 microversion: 2.1 time: 0.236665 Jul 24 01:17:12.454120 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 326/632] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:12 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:13.464786 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-51318748-a393-4300-bf28-e89e09b0b506 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:13.465380 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-51318748-a393-4300-bf28-e89e09b0b506 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:13.472579 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-51318748-a393-4300-bf28-e89e09b0b506 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.473030 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-51318748-a393-4300-bf28-e89e09b0b506 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.473855 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-51318748-a393-4300-bf28-e89e09b0b506 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.473994 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9f7aa811-44ad-44d4-b439-2417d33c4e7d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:13.474401 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-51318748-a393-4300-bf28-e89e09b0b506 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.474628 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9f7aa811-44ad-44d4-b439-2417d33c4e7d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:13.481586 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f7aa811-44ad-44d4-b439-2417d33c4e7d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.482029 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f7aa811-44ad-44d4-b439-2417d33c4e7d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.482755 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f7aa811-44ad-44d4-b439-2417d33c4e7d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.483183 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f7aa811-44ad-44d4-b439-2417d33c4e7d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.666095 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-51318748-a393-4300-bf28-e89e09b0b506 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:13.670432 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9f7aa811-44ad-44d4-b439-2417d33c4e7d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:13.674564 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-51318748-a393-4300-bf28-e89e09b0b506 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1555 microversion: 2.1 time: 0.215540 Jul 24 01:17:13.675151 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 307/633] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:13 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:13.682589 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9f7aa811-44ad-44d4-b439-2417d33c4e7d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1365 microversion: 2.1 time: 0.212304 Jul 24 01:17:13.683127 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 327/634] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:13 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:14.229966 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-62a85f4f-e0ab-4032-bb03-d4ec537c7d87 req-a063f59f-a80b-4a98-951d-7853aaf57b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f1a40f-b6a7-433a-8a0a-83126081a557", "name": "network-vif-deleted", "tag": "d7404b6e-b96a-4369-8b9a-a904feefadaa"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:14.238551 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-62a85f4f-e0ab-4032-bb03-d4ec537c7d87 req-a063f59f-a80b-4a98-951d-7853aaf57b16 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.239130 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-62a85f4f-e0ab-4032-bb03-d4ec537c7d87 req-a063f59f-a80b-4a98-951d-7853aaf57b16 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.250834 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-62a85f4f-e0ab-4032-bb03-d4ec537c7d87 req-a063f59f-a80b-4a98-951d-7853aaf57b16 service nova] Creating event network-vif-deleted:d7404b6e-b96a-4369-8b9a-a904feefadaa for instance d1f1a40f-b6a7-433a-8a0a-83126081a557 on hv-cinder-maste Jul 24 01:17:14.255956 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-62a85f4f-e0ab-4032-bb03-d4ec537c7d87 req-a063f59f-a80b-4a98-951d-7853aaf57b16 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029641 Jul 24 01:17:14.256557 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 308/635] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:14.263257 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-e2865722-e3ce-4d10-9b49-be4495813ce2 req-0e23242e-ae85-461e-a874-abf9607aada6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0506b1-88fd-49f6-a2f5-88288c722940", "name": "network-vif-plugged", "status": "completed", "tag": "1ab3d91c-9b3a-47af-b569-49fa8cc163f2"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:14.272976 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-e2865722-e3ce-4d10-9b49-be4495813ce2 req-0e23242e-ae85-461e-a874-abf9607aada6 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.273546 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-e2865722-e3ce-4d10-9b49-be4495813ce2 req-0e23242e-ae85-461e-a874-abf9607aada6 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.288853 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-e2865722-e3ce-4d10-9b49-be4495813ce2 req-0e23242e-ae85-461e-a874-abf9607aada6 service nova] Creating event network-vif-plugged:1ab3d91c-9b3a-47af-b569-49fa8cc163f2 for instance dc0506b1-88fd-49f6-a2f5-88288c722940 on hv-cinder-maste Jul 24 01:17:14.294398 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-e2865722-e3ce-4d10-9b49-be4495813ce2 req-0e23242e-ae85-461e-a874-abf9607aada6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037170 Jul 24 01:17:14.295221 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 328/636] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:14.693207 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:14.694716 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:14.699974 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4a025b05-e39f-4700-8f59-dcdcf2d3c468 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:14.700821 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4a025b05-e39f-4700-8f59-dcdcf2d3c468 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:14.701386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.701891 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.702636 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.703069 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.708644 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4a025b05-e39f-4700-8f59-dcdcf2d3c468 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.709088 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4a025b05-e39f-4700-8f59-dcdcf2d3c468 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.709873 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4a025b05-e39f-4700-8f59-dcdcf2d3c468 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.710287 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4a025b05-e39f-4700-8f59-dcdcf2d3c468 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.736858 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.737680 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.738340 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lazy-loading 'fault' on Instance uuid d1f1a40f-b6a7-433a-8a0a-83126081a557 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:17:14.821852 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0398a0ec144dfcbcc4c92fc54d4dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083e6e1f36c3453da2befa06a4875014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:14.834601 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-194151dc-32cb-4f7c-9297-80dda772a904 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 200 len: 1348 microversion: 2.1 time: 0.146178 Jul 24 01:17:14.835427 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 309/637] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:14 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 1348 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:14.941921 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4a025b05-e39f-4700-8f59-dcdcf2d3c468 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:14.951556 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4a025b05-e39f-4700-8f59-dcdcf2d3c468 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1365 microversion: 2.1 time: 0.256494 Jul 24 01:17:14.955205 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 329/638] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:14 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:15.852486 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.853046 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] [instance: d1f1a40f-b6a7-433a-8a0a-83126081a557] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:15.855054 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:15.861279 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.861746 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.862524 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.862950 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.876586 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] HTTP exception thrown: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 could not be found. Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Request method failure captured: Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 HTTP/1.1 Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JybMzT5Zh1vIS4hQ8CrvJBM6HyAl69H7IdGr1j4nz_wVSXq6ijqZRZszqUMhbGDrtpeK-odNg-LLuvk2z2OW_9827WridlRiFBFeMuTUvnPS_TsoNex2btAjC6kUlqYTgz2Tp7uTx8NHcd14RPSqHBAbxn3rf06uo3R93N_vfZz4Zw Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 083e6e1f36c3453da2befa06a4875014 Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-TestMinimumBasicScenario-846245326 Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:17:15.878217 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/083e6e1f36c3453da2befa06a4875014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_083e6e1f36c3453da2befa06a4875014", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/083e6e1f36c3453da2befa06a4875014"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/083e6e1f36c3453da2befa06a4875014"}]}] Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-TestMinimumBasicScenario-846245326 Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 083e6e1f36c3453da2befa06a4875014 Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-TestMinimumBasicScenario-846245326 Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-TestMinimumBasicScenario-846245326-project Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 9a0398a0ec144dfcbcc4c92fc54d4dee Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-TestMinimumBasicScenario-846245326-project Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 could not be found. Jul 24 01:17:15.879800 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'd1f1a40f-b6a7-433a-8a0a-83126081a557'} Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 could not be found. Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:15.880682 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 could not be found. Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 could not be found. Jul 24 01:17:15.882073 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.883404 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Returning 404 to user: Instance d1f1a40f-b6a7-433a-8a0a-83126081a557 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:15.883404 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-381b5513-d2d8-4bce-b4a7-0c05f6680610 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557" status: 404 len: 111 microversion: 2.1 time: 0.031066 Jul 24 01:17:15.883404 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 310/639] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:15 2022] GET /compute/v2.1/servers/d1f1a40f-b6a7-433a-8a0a-83126081a557 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:15.888557 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-33af303c-47c4-4e31-8b81-11b3c81ccb41 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] Calling method '.version_select at 0x7fdf2ffc8940>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.891812 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:15.892542 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=10 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:15.900883 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:15.910036 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-33af303c-47c4-4e31-8b81-11b3c81ccb41 tempest-TestMinimumBasicScenario-846245326 tempest-TestMinimumBasicScenario-846245326-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1487358931" status: 202 len: 0 microversion: 2.1 time: 0.025389 Jul 24 01:17:15.910623 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 330/640] 10.222.0.42 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1487358931 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:15.968456 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-53edd682-252a-472c-82a1-5b1339462aae tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.969081 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-53edd682-252a-472c-82a1-5b1339462aae tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:15.975070 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53edd682-252a-472c-82a1-5b1339462aae tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.975623 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53edd682-252a-472c-82a1-5b1339462aae tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.976400 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53edd682-252a-472c-82a1-5b1339462aae tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.976834 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53edd682-252a-472c-82a1-5b1339462aae tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.355197 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-53edd682-252a-472c-82a1-5b1339462aae tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:16.363701 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-53edd682-252a-472c-82a1-5b1339462aae tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1365 microversion: 2.1 time: 0.399126 Jul 24 01:17:16.364256 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 311/641] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:15 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1365 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:17.382154 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1f892590-ae4c-4aae-a00f-50ec42ee5a7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:17.382717 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1f892590-ae4c-4aae-a00f-50ec42ee5a7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:17.390606 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1f892590-ae4c-4aae-a00f-50ec42ee5a7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:17.391050 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1f892590-ae4c-4aae-a00f-50ec42ee5a7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:17.391834 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1f892590-ae4c-4aae-a00f-50ec42ee5a7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:17.392269 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1f892590-ae4c-4aae-a00f-50ec42ee5a7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:17.589057 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1f892590-ae4c-4aae-a00f-50ec42ee5a7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:17.597504 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1f892590-ae4c-4aae-a00f-50ec42ee5a7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1555 microversion: 2.1 time: 0.220314 Jul 24 01:17:17.609917 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 331/642] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:17 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:17.615805 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6c947278-882d-492a-b697-8cd536c7627a tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:17.616375 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6c947278-882d-492a-b697-8cd536c7627a tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:17.623245 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6c947278-882d-492a-b697-8cd536c7627a tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:17.623758 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6c947278-882d-492a-b697-8cd536c7627a tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:17.624528 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6c947278-882d-492a-b697-8cd536c7627a tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:17.624948 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6c947278-882d-492a-b697-8cd536c7627a tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:17.740267 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6c947278-882d-492a-b697-8cd536c7627a tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128283 Jul 24 01:17:17.740742 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 312/643] 10.222.0.42 () {58 vars in 1274 bytes} [Sun Jul 24 01:17:17 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:18.689263 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-b88ad4a7-b608-43a5-9a84-b25aefeb039d req-becec718-6133-4ea3-a651-451b302a8e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0506b1-88fd-49f6-a2f5-88288c722940", "tag": "1ab3d91c-9b3a-47af-b569-49fa8cc163f2"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:18.699368 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-b88ad4a7-b608-43a5-9a84-b25aefeb039d req-becec718-6133-4ea3-a651-451b302a8e0e service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.699817 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-b88ad4a7-b608-43a5-9a84-b25aefeb039d req-becec718-6133-4ea3-a651-451b302a8e0e service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.711029 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-b88ad4a7-b608-43a5-9a84-b25aefeb039d req-becec718-6133-4ea3-a651-451b302a8e0e service nova] Creating event network-changed:1ab3d91c-9b3a-47af-b569-49fa8cc163f2 for instance dc0506b1-88fd-49f6-a2f5-88288c722940 on hv-cinder-maste Jul 24 01:17:18.716330 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-b88ad4a7-b608-43a5-9a84-b25aefeb039d req-becec718-6133-4ea3-a651-451b302a8e0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030713 Jul 24 01:17:18.717247 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 332/644] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:34.008564 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=15 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:34.009263 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=97 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:34.185836 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7bd72f90-25b0-41f7-88b7-8b73b5698742 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Action: 'create', calling method: .version_select at 0x7fdf3c2181f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-936937939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMT4m/E7EVQMZL729OffrMlcCPw0dOZ5fyyuN6Fohei8FZj+tXHXyrNmCPoqkBU4T13rAXCGW7ey1Divf48MBUyRleybf3ZAD9EAYC+r6v/TnNfuJGl2rjth7/lmGe4Kg=="}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:34.200317 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-7bd72f90-25b0-41f7-88b7-8b73b5698742 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Getting quotas for project 935463280c7a4d6eaab209974e8b1bf8. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:34.204209 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-7bd72f90-25b0-41f7-88b7-8b73b5698742 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Getting quotas for user 2f6dd6349c9a467ca7cd5aaf1b9c6a07 and project 935463280c7a4d6eaab209974e8b1bf8. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:34.228743 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7bd72f90-25b0-41f7-88b7-8b73b5698742 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.221701 Jul 24 01:17:34.229301 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 313/645] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:46.298241 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=4 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:46.299357 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:46.304285 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ba1b2303-3fee-49ce-b6e2-ecf8b15a7a2c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:46.305458 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ba1b2303-3fee-49ce-b6e2-ecf8b15a7a2c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:46.313736 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ba1b2303-3fee-49ce-b6e2-ecf8b15a7a2c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.314254 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ba1b2303-3fee-49ce-b6e2-ecf8b15a7a2c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.315210 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ba1b2303-3fee-49ce-b6e2-ecf8b15a7a2c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.315659 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ba1b2303-3fee-49ce-b6e2-ecf8b15a7a2c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.346783 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ba1b2303-3fee-49ce-b6e2-ecf8b15a7a2c tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050689 Jul 24 01:17:46.347350 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 333/646] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:17:46 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:17:46.403491 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=4 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:46.404625 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:46.408746 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-eb28e4d4-f009-4426-bb25-72657fd0894e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:46.409241 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-eb28e4d4-f009-4426-bb25-72657fd0894e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:46.415995 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb28e4d4-f009-4426-bb25-72657fd0894e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.416454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb28e4d4-f009-4426-bb25-72657fd0894e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.417276 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb28e4d4-f009-4426-bb25-72657fd0894e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.417768 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-eb28e4d4-f009-4426-bb25-72657fd0894e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.444340 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-eb28e4d4-f009-4426-bb25-72657fd0894e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Going to try to terminate instance {{(pid=118036) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:46.528018 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-eb28e4d4-f009-4426-bb25-72657fd0894e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 204 len: 0 microversion: 2.1 time: 0.125434 Jul 24 01:17:46.528759 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 314/647] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:46 2022] DELETE /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:46.539524 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ec91e5ee-d89c-4b59-8402-1d8e76417936 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:46.540250 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ec91e5ee-d89c-4b59-8402-1d8e76417936 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:46.547588 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ec91e5ee-d89c-4b59-8402-1d8e76417936 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.548040 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ec91e5ee-d89c-4b59-8402-1d8e76417936 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.549197 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ec91e5ee-d89c-4b59-8402-1d8e76417936 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.549629 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ec91e5ee-d89c-4b59-8402-1d8e76417936 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.684862 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ec91e5ee-d89c-4b59-8402-1d8e76417936 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:46.692648 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ec91e5ee-d89c-4b59-8402-1d8e76417936 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1675 microversion: 2.1 time: 0.159068 Jul 24 01:17:46.693219 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 334/648] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:46 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:47.718976 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5792c3d5-453c-44df-9c16-57d15294ab2a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:47.720151 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5792c3d5-453c-44df-9c16-57d15294ab2a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:47.731491 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5792c3d5-453c-44df-9c16-57d15294ab2a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.732181 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5792c3d5-453c-44df-9c16-57d15294ab2a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:47.733516 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5792c3d5-453c-44df-9c16-57d15294ab2a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.734150 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5792c3d5-453c-44df-9c16-57d15294ab2a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:47.869846 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5792c3d5-453c-44df-9c16-57d15294ab2a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:47.877587 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5792c3d5-453c-44df-9c16-57d15294ab2a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1675 microversion: 2.1 time: 0.165538 Jul 24 01:17:47.878164 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 315/649] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:47 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:48.894354 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-00c28bec-d33e-47a2-9296-72f9b3671022 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:48.895044 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-00c28bec-d33e-47a2-9296-72f9b3671022 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:48.902202 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-00c28bec-d33e-47a2-9296-72f9b3671022 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:48.902758 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-00c28bec-d33e-47a2-9296-72f9b3671022 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:48.903624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-00c28bec-d33e-47a2-9296-72f9b3671022 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:48.904130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-00c28bec-d33e-47a2-9296-72f9b3671022 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:49.127405 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-00c28bec-d33e-47a2-9296-72f9b3671022 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:49.135144 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-00c28bec-d33e-47a2-9296-72f9b3671022 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 200 len: 1675 microversion: 2.1 time: 0.244761 Jul 24 01:17:49.135753 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 335/650] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:48 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:49.465080 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-a8e8a505-5208-4bb5-b208-612a371a19da req-da18c301-4b26-4b4f-a24e-a1c816561142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c12186-86f3-4887-9e0a-ed1b48f307ba", "name": "network-vif-deleted", "tag": "d85b179a-7a05-4ea4-8139-bc1c8fc67296"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:49.473493 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a8e8a505-5208-4bb5-b208-612a371a19da req-da18c301-4b26-4b4f-a24e-a1c816561142 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:49.474060 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a8e8a505-5208-4bb5-b208-612a371a19da req-da18c301-4b26-4b4f-a24e-a1c816561142 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:49.485701 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-a8e8a505-5208-4bb5-b208-612a371a19da req-da18c301-4b26-4b4f-a24e-a1c816561142 service nova] Creating event network-vif-deleted:d85b179a-7a05-4ea4-8139-bc1c8fc67296 for instance 76c12186-86f3-4887-9e0a-ed1b48f307ba on hv-cinder-maste Jul 24 01:17:49.491621 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-a8e8a505-5208-4bb5-b208-612a371a19da req-da18c301-4b26-4b4f-a24e-a1c816561142 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092543 Jul 24 01:17:49.493129 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 316/651] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:50.152202 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:50.152960 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:50.159798 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:50.160279 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:50.161106 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:50.161515 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:50.178221 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] HTTP exception thrown: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Request method failure captured: Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba HTTP/1.1 Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3Jxb_CJGvwGq8heUUEy3PjUz4phhRL8nkX0-X_9606kxTANwH4xr9LIMjUfjoAE3x9SO89WGveJXsqABpLTPHFKHDtskGFRoy_kwhaa157u4CjlrHAXDP5jAL-bTVsTQ1X0PM8V7KGSIcC_ReiIEIRd9ZO_eZaZpasbZkySFNlM5WZM Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:17:50.179899 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cc1d39abfaef4e9c80564f545f431bbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}] Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 601f4db65bf74587ab9b0080a44b4f79 Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:17:50.181305 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '76c12186-86f3-4887-9e0a-ed1b48f307ba'} Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:50.182092 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:17:50.183414 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:17:50.184548 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Returning 404 to user: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:50.184548 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d3ee0c14-ecd3-444a-ba76-073b7537e29e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 404 len: 111 microversion: 2.1 time: 0.033312 Jul 24 01:17:50.185449 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 336/652] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:50 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:50.191115 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-41708d6c-2ccd-4f29-93ee-af0616c1ea34 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '.version_select at 0x7fdf3c0c5430>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:50.211321 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-41708d6c-2ccd-4f29-93ee-af0616c1ea34 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648629464" status: 202 len: 0 microversion: 2.1 time: 0.024475 Jul 24 01:17:50.211909 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 317/653] 10.222.0.42 () {58 vars in 1220 bytes} [Sun Jul 24 01:17:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648629464 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:17:50.856836 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-fdaef74a-a73e-49da-af25-65c47ca5f320 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'create', calling method: .version_select at 0x7fdf2ff7a0d0>, body: {"keypair": {"name": "tempest-keypair-1435286646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAq9usVWGb7+SMKi47fNNr5qZJzQcDtTyf+EMGYZFxlXqkAudrd3b7VrgcWjYq1PzxLubqgoMRy9hWvjlrFySP4O5v4ZTneibA8zJS/yyq7+/Y31h5gxUDl41uqr71n8Qw=="}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:50.871059 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-fdaef74a-a73e-49da-af25-65c47ca5f320 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Getting quotas for project cc1d39abfaef4e9c80564f545f431bbe. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:50.874891 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-fdaef74a-a73e-49da-af25-65c47ca5f320 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Getting quotas for user 601f4db65bf74587ab9b0080a44b4f79 and project cc1d39abfaef4e9c80564f545f431bbe. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:50.898942 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-fdaef74a-a73e-49da-af25-65c47ca5f320 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046148 Jul 24 01:17:50.899543 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 337/654] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:52.220286 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-592289851", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cbf3785-1abb-4c73-84eb-0d42ef9e3194"}], "security_groups": [{"name": "tempest-securitygroup--277461456"}], "key_name": "tempest-keypair-1435286646", "user_data": "}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:52.326548 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] validate_networks() for [('2cbf3785-1abb-4c73-84eb-0d42ef9e3194', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:17:52.834119 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:17:52.834538 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:17:52.835036 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:17:52.835468 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:17:52.835879 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:17:52.845183 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:52.845635 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:52.846461 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:52.846890 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:52.866161 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Getting quotas for project cc1d39abfaef4e9c80564f545f431bbe. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:52.870311 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Getting quotas for user 601f4db65bf74587ab9b0080a44b4f79 and project cc1d39abfaef4e9c80564f545f431bbe. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:52.881695 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:17:52.884036 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:17:52.936406 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ff9bccc0-de9b-4930-9c0a-3f126129d2fd tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.720926 Jul 24 01:17:52.937016 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 318/655] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:17:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:17:52.947958 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7e7b8bfc-a439-415c-b8a0-cb51f82f6c8b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:52.948670 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7e7b8bfc-a439-415c-b8a0-cb51f82f6c8b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:53.002901 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7e7b8bfc-a439-415c-b8a0-cb51f82f6c8b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:53.011013 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7e7b8bfc-a439-415c-b8a0-cb51f82f6c8b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1237 microversion: 2.1 time: 0.067566 Jul 24 01:17:53.011606 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 338/656] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:52 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:54.032766 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ddedd0a3-99c2-462c-80d1-95c991a55404 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:54.033371 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ddedd0a3-99c2-462c-80d1-95c991a55404 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:54.041574 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddedd0a3-99c2-462c-80d1-95c991a55404 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:54.042286 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddedd0a3-99c2-462c-80d1-95c991a55404 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:54.043073 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddedd0a3-99c2-462c-80d1-95c991a55404 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:54.043545 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddedd0a3-99c2-462c-80d1-95c991a55404 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:54.122312 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ddedd0a3-99c2-462c-80d1-95c991a55404 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:54.130419 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ddedd0a3-99c2-462c-80d1-95c991a55404 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1297 microversion: 2.1 time: 0.101951 Jul 24 01:17:54.131078 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 319/657] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:54 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:54.637866 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2017498515", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-936937939", "security_groups": [{"name": "tempest-secgroup-smoke-228475274"}], "networks": [{"uuid": "1c4c17c9-7e08-4c1e-b505-62479f6c9e94"}], "block_device_mapping_v2": [{"uuid": "d63f2bf8-bb1a-4027-acc6-1682740e6a3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:54.788194 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.network.neutron [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] validate_networks() for [('1c4c17c9-7e08-4c1e-b505-62479f6c9e94', None, None, None, None, None)] {{(pid=118035) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:17:55.148089 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-76710f7e-572d-4fe5-9683-790fcbe99a8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:55.148769 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-76710f7e-572d-4fe5-9683-790fcbe99a8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:55.155672 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-76710f7e-572d-4fe5-9683-790fcbe99a8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.156206 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-76710f7e-572d-4fe5-9683-790fcbe99a8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.157053 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-76710f7e-572d-4fe5-9683-790fcbe99a8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.157571 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-76710f7e-572d-4fe5-9683-790fcbe99a8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.453710 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-76710f7e-572d-4fe5-9683-790fcbe99a8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:55.461513 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-76710f7e-572d-4fe5-9683-790fcbe99a8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.317493 Jul 24 01:17:55.462305 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 320/658] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:55 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:55.509006 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Flavor limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:17:55.509497 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Image limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:17:55.510073 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Flavor pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:17:55.510548 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Image pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:17:55.511022 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:17:55.520694 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.521223 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.522020 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.522455 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.541024 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Getting quotas for project 935463280c7a4d6eaab209974e8b1bf8. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:55.545700 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Getting quotas for user 2f6dd6349c9a467ca7cd5aaf1b9c6a07 and project 935463280c7a4d6eaab209974e8b1bf8. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:55.604337 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Going to run 1 instances... {{(pid=118035) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:17:55.606459 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d63f2bf8-bb1a-4027-acc6-1682740e6a3a',volume_size=None,volume_type=None)] {{(pid=118035) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:17:55.777669 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-67df0905-aab1-4a76-a2e5-061067f57cf2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.143726 Jul 24 01:17:55.779531 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 339/659] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:17:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:17:55.790043 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c310c7e6-8340-425a-98ae-c5ea3cef3d82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:55.790676 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c310c7e6-8340-425a-98ae-c5ea3cef3d82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:55.852936 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-4c6d3dd9-3bf0-48aa-89e5-3f9cb241938b req-2a014ad6-0c4a-4988-909d-68f31079bda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bec98a72-8d97-4a98-80b3-f5d0a6adce26", "tag": "bd7d30c1-3271-400d-a012-93da64c9b5f7"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:55.866935 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-4c6d3dd9-3bf0-48aa-89e5-3f9cb241938b req-2a014ad6-0c4a-4988-909d-68f31079bda5 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.867839 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-4c6d3dd9-3bf0-48aa-89e5-3f9cb241938b req-2a014ad6-0c4a-4988-909d-68f31079bda5 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.881399 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-4c6d3dd9-3bf0-48aa-89e5-3f9cb241938b req-2a014ad6-0c4a-4988-909d-68f31079bda5 service nova] Creating event network-changed:bd7d30c1-3271-400d-a012-93da64c9b5f7 for instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 on hv-cinder-maste Jul 24 01:17:55.887156 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-4c6d3dd9-3bf0-48aa-89e5-3f9cb241938b req-2a014ad6-0c4a-4988-909d-68f31079bda5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039862 Jul 24 01:17:55.892090 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 340/660] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:55.918561 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c310c7e6-8340-425a-98ae-c5ea3cef3d82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:55.928818 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c310c7e6-8340-425a-98ae-c5ea3cef3d82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1088 microversion: 2.1 time: 0.142609 Jul 24 01:17:55.929649 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 321/661] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:55 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1088 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:56.479017 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f8f8e8c7-b92d-41aa-bb88-d6226ebb027d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:56.479993 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f8f8e8c7-b92d-41aa-bb88-d6226ebb027d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:56.486538 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f8f8e8c7-b92d-41aa-bb88-d6226ebb027d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.487094 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f8f8e8c7-b92d-41aa-bb88-d6226ebb027d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:56.487990 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f8f8e8c7-b92d-41aa-bb88-d6226ebb027d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.488488 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f8f8e8c7-b92d-41aa-bb88-d6226ebb027d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:56.619262 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f8f8e8c7-b92d-41aa-bb88-d6226ebb027d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:56.626783 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f8f8e8c7-b92d-41aa-bb88-d6226ebb027d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.152388 Jul 24 01:17:56.627367 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 341/662] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:56 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:56.946381 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-37f0777d-25ec-48b5-b462-adf0016f9ac5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:56.946967 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-37f0777d-25ec-48b5-b462-adf0016f9ac5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:56.954102 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-37f0777d-25ec-48b5-b462-adf0016f9ac5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.954476 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-37f0777d-25ec-48b5-b462-adf0016f9ac5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:56.955270 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-37f0777d-25ec-48b5-b462-adf0016f9ac5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.955751 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-37f0777d-25ec-48b5-b462-adf0016f9ac5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.016616 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-37f0777d-25ec-48b5-b462-adf0016f9ac5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:57.024410 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-37f0777d-25ec-48b5-b462-adf0016f9ac5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1204 microversion: 2.1 time: 0.082132 Jul 24 01:17:57.024965 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 322/663] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:56 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1204 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:57.646798 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5a898e2a-edb2-4ba3-b475-341836c31d41 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:57.647906 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-5a898e2a-edb2-4ba3-b475-341836c31d41 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:57.659030 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a898e2a-edb2-4ba3-b475-341836c31d41 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.659893 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a898e2a-edb2-4ba3-b475-341836c31d41 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.661158 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a898e2a-edb2-4ba3-b475-341836c31d41 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.661931 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a898e2a-edb2-4ba3-b475-341836c31d41 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.806745 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-5a898e2a-edb2-4ba3-b475-341836c31d41 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:57.815465 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5a898e2a-edb2-4ba3-b475-341836c31d41 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.174987 Jul 24 01:17:57.816251 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 342/664] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:57 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:58.046292 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-90408b1a-e778-494a-9881-dc2c1a11bfad tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:58.047344 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-90408b1a-e778-494a-9881-dc2c1a11bfad tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:58.056268 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-90408b1a-e778-494a-9881-dc2c1a11bfad tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.056714 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-90408b1a-e778-494a-9881-dc2c1a11bfad tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.057474 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-90408b1a-e778-494a-9881-dc2c1a11bfad tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.057913 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-90408b1a-e778-494a-9881-dc2c1a11bfad tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.120244 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-90408b1a-e778-494a-9881-dc2c1a11bfad tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:58.128126 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-90408b1a-e778-494a-9881-dc2c1a11bfad tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1204 microversion: 2.1 time: 0.088836 Jul 24 01:17:58.134187 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 323/665] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:58 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:58.836848 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6d0cb6c1-5404-4828-876f-bf0885d5d134 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:58.837687 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6d0cb6c1-5404-4828-876f-bf0885d5d134 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:58.845619 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6d0cb6c1-5404-4828-876f-bf0885d5d134 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.846282 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6d0cb6c1-5404-4828-876f-bf0885d5d134 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.847333 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6d0cb6c1-5404-4828-876f-bf0885d5d134 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.848009 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6d0cb6c1-5404-4828-876f-bf0885d5d134 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.986691 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6d0cb6c1-5404-4828-876f-bf0885d5d134 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:58.997835 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6d0cb6c1-5404-4828-876f-bf0885d5d134 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.167447 Jul 24 01:17:58.998601 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 343/666] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:58 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:59.148935 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e04c8177-0bf0-425d-bd28-0dedd307338b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:59.149780 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e04c8177-0bf0-425d-bd28-0dedd307338b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:59.160881 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e04c8177-0bf0-425d-bd28-0dedd307338b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:59.161657 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e04c8177-0bf0-425d-bd28-0dedd307338b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:59.162790 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e04c8177-0bf0-425d-bd28-0dedd307338b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:59.163221 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e04c8177-0bf0-425d-bd28-0dedd307338b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:59.252492 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e04c8177-0bf0-425d-bd28-0dedd307338b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:59.261614 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e04c8177-0bf0-425d-bd28-0dedd307338b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1204 microversion: 2.1 time: 0.119004 Jul 24 01:17:59.262044 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 324/667] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:59 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1204 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:00.017116 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-65160964-325f-44b4-aaf1-ac4f49e9f5cf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:00.017724 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-65160964-325f-44b4-aaf1-ac4f49e9f5cf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:00.025834 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-65160964-325f-44b4-aaf1-ac4f49e9f5cf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.026577 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-65160964-325f-44b4-aaf1-ac4f49e9f5cf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.027574 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-65160964-325f-44b4-aaf1-ac4f49e9f5cf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.028051 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-65160964-325f-44b4-aaf1-ac4f49e9f5cf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.260474 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-65160964-325f-44b4-aaf1-ac4f49e9f5cf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:00.269526 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-65160964-325f-44b4-aaf1-ac4f49e9f5cf tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.256243 Jul 24 01:18:00.270398 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 344/668] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:00 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:00.278171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-951b98ed-1fd9-462e-9707-23581c6ab25d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:00.279947 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-951b98ed-1fd9-462e-9707-23581c6ab25d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:00.287059 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-951b98ed-1fd9-462e-9707-23581c6ab25d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.287539 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-951b98ed-1fd9-462e-9707-23581c6ab25d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.288290 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-951b98ed-1fd9-462e-9707-23581c6ab25d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.288914 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-951b98ed-1fd9-462e-9707-23581c6ab25d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.491707 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-951b98ed-1fd9-462e-9707-23581c6ab25d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:00.500616 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-951b98ed-1fd9-462e-9707-23581c6ab25d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.225818 Jul 24 01:18:00.501191 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 325/669] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:00 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:00.786777 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-b243fa53-da6f-472d-9bfc-fd90e7e8c5de req-c9fb9dc4-ad79-4045-9f0a-80e0f2243696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4800d3-ad11-46dd-90db-b763e1944b9e", "tag": "a4e927a5-ea6b-4827-aa7b-42a260b70350"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:00.796136 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-b243fa53-da6f-472d-9bfc-fd90e7e8c5de req-c9fb9dc4-ad79-4045-9f0a-80e0f2243696 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.796935 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-b243fa53-da6f-472d-9bfc-fd90e7e8c5de req-c9fb9dc4-ad79-4045-9f0a-80e0f2243696 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.816428 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-b243fa53-da6f-472d-9bfc-fd90e7e8c5de req-c9fb9dc4-ad79-4045-9f0a-80e0f2243696 service nova] Creating event network-changed:a4e927a5-ea6b-4827-aa7b-42a260b70350 for instance cb4800d3-ad11-46dd-90db-b763e1944b9e on hv-cinder-maste Jul 24 01:18:00.825829 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-b243fa53-da6f-472d-9bfc-fd90e7e8c5de req-c9fb9dc4-ad79-4045-9f0a-80e0f2243696 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041779 Jul 24 01:18:00.825829 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 345/670] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:00.863673 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-23a3e8f8-89fe-4707-a967-dc0bd56e710b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:00.864174 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-23a3e8f8-89fe-4707-a967-dc0bd56e710b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:00.870514 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-23a3e8f8-89fe-4707-a967-dc0bd56e710b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.870964 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-23a3e8f8-89fe-4707-a967-dc0bd56e710b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.871793 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-23a3e8f8-89fe-4707-a967-dc0bd56e710b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.872222 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-23a3e8f8-89fe-4707-a967-dc0bd56e710b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.962256 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-23a3e8f8-89fe-4707-a967-dc0bd56e710b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lazy-loading 'services' on Instance uuid d614ca48-40f2-4927-a2a9-65a14f2fe0a1 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:01.049419 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-23a3e8f8-89fe-4707-a967-dc0bd56e710b tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments/a93f31a1-765a-4766-b47e-6739ec74b9b6" status: 202 len: 0 microversion: 2.1 time: 0.189662 Jul 24 01:18:01.051121 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 326/671] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:18:00 2022] DELETE /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments/a93f31a1-765a-4766-b47e-6739ec74b9b6 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:18:01.060237 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b709baaf-d57b-42b6-9a17-35a9e9bcc4a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:01.063315 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b709baaf-d57b-42b6-9a17-35a9e9bcc4a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:01.074046 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b709baaf-d57b-42b6-9a17-35a9e9bcc4a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.075253 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b709baaf-d57b-42b6-9a17-35a9e9bcc4a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.076349 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b709baaf-d57b-42b6-9a17-35a9e9bcc4a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.077006 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b709baaf-d57b-42b6-9a17-35a9e9bcc4a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.106959 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b709baaf-d57b-42b6-9a17-35a9e9bcc4a9 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051907 Jul 24 01:18:01.107558 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 346/672] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:18:01 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:01.291130 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ddce03f7-72d9-440f-b7b6-110f9223c8ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:01.292251 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ddce03f7-72d9-440f-b7b6-110f9223c8ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:01.304096 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddce03f7-72d9-440f-b7b6-110f9223c8ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.304824 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddce03f7-72d9-440f-b7b6-110f9223c8ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.306077 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddce03f7-72d9-440f-b7b6-110f9223c8ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.306795 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ddce03f7-72d9-440f-b7b6-110f9223c8ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.442579 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ddce03f7-72d9-440f-b7b6-110f9223c8ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:01.450579 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ddce03f7-72d9-440f-b7b6-110f9223c8ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.166628 Jul 24 01:18:01.451146 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 327/673] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:01 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:01.521821 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0f6bfd1f-ad69-449e-91df-7f6d2c08ea9e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:01.522936 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0f6bfd1f-ad69-449e-91df-7f6d2c08ea9e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:01.534080 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0f6bfd1f-ad69-449e-91df-7f6d2c08ea9e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.534852 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0f6bfd1f-ad69-449e-91df-7f6d2c08ea9e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.536189 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0f6bfd1f-ad69-449e-91df-7f6d2c08ea9e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.536887 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0f6bfd1f-ad69-449e-91df-7f6d2c08ea9e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.742502 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0f6bfd1f-ad69-449e-91df-7f6d2c08ea9e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:01.750578 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0f6bfd1f-ad69-449e-91df-7f6d2c08ea9e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.235211 Jul 24 01:18:01.751144 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 347/674] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:01 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:02.123808 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0d077bd2-5198-4fd9-8306-38ac878d53a1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:02.125525 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0d077bd2-5198-4fd9-8306-38ac878d53a1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:02.134227 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d077bd2-5198-4fd9-8306-38ac878d53a1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.134675 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d077bd2-5198-4fd9-8306-38ac878d53a1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.135471 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d077bd2-5198-4fd9-8306-38ac878d53a1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.135904 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d077bd2-5198-4fd9-8306-38ac878d53a1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.164740 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0d077bd2-5198-4fd9-8306-38ac878d53a1 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047850 Jul 24 01:18:02.165306 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 328/675] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:18:02 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:02.467981 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e2cc5b19-9799-497b-aa28-55531b27b22e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:02.468968 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e2cc5b19-9799-497b-aa28-55531b27b22e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:02.476612 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e2cc5b19-9799-497b-aa28-55531b27b22e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.477350 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e2cc5b19-9799-497b-aa28-55531b27b22e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.483008 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-8d17e65b-c217-487b-9935-8e3a7f501a74 req-a94ec13a-d26c-4868-a639-18971b41daae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bec98a72-8d97-4a98-80b3-f5d0a6adce26", "name": "network-vif-plugged", "status": "completed", "tag": "bd7d30c1-3271-400d-a012-93da64c9b5f7"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:02.488358 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e2cc5b19-9799-497b-aa28-55531b27b22e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.488800 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e2cc5b19-9799-497b-aa28-55531b27b22e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.491744 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-8d17e65b-c217-487b-9935-8e3a7f501a74 req-a94ec13a-d26c-4868-a639-18971b41daae service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.492193 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-8d17e65b-c217-487b-9935-8e3a7f501a74 req-a94ec13a-d26c-4868-a639-18971b41daae service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.503219 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-8d17e65b-c217-487b-9935-8e3a7f501a74 req-a94ec13a-d26c-4868-a639-18971b41daae service nova] Creating event network-vif-plugged:bd7d30c1-3271-400d-a012-93da64c9b5f7 for instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 on hv-cinder-maste Jul 24 01:18:02.508583 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-8d17e65b-c217-487b-9935-8e3a7f501a74 req-a94ec13a-d26c-4868-a639-18971b41daae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089938 Jul 24 01:18:02.509415 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 348/676] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:02.629273 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e2cc5b19-9799-497b-aa28-55531b27b22e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:02.640489 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e2cc5b19-9799-497b-aa28-55531b27b22e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.177424 Jul 24 01:18:02.641459 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 329/677] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:02 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:02.772908 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-68b54517-0686-4ba5-a9c8-154dddc0c1cc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:02.773980 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-68b54517-0686-4ba5-a9c8-154dddc0c1cc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:02.784685 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-68b54517-0686-4ba5-a9c8-154dddc0c1cc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.785472 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-68b54517-0686-4ba5-a9c8-154dddc0c1cc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.786785 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-68b54517-0686-4ba5-a9c8-154dddc0c1cc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.787565 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-68b54517-0686-4ba5-a9c8-154dddc0c1cc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.928883 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-68b54517-0686-4ba5-a9c8-154dddc0c1cc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:02.936524 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-68b54517-0686-4ba5-a9c8-154dddc0c1cc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.170930 Jul 24 01:18:02.937098 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 349/678] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:02 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:03.177440 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-780a7e82-a101-45c1-a898-ab075ee4f808 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:03.178483 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-780a7e82-a101-45c1-a898-ab075ee4f808 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:03.180518 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:03.186406 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-780a7e82-a101-45c1-a898-ab075ee4f808 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.186855 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-780a7e82-a101-45c1-a898-ab075ee4f808 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.187651 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-780a7e82-a101-45c1-a898-ab075ee4f808 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.188088 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-780a7e82-a101-45c1-a898-ab075ee4f808 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.218685 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-780a7e82-a101-45c1-a898-ab075ee4f808 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045659 Jul 24 01:18:03.219237 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 330/679] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:18:03 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:03.661519 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0fa27c0d-8de2-42c7-8d10-51b5dbde72ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:03.662547 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0fa27c0d-8de2-42c7-8d10-51b5dbde72ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:03.670253 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0fa27c0d-8de2-42c7-8d10-51b5dbde72ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.670754 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0fa27c0d-8de2-42c7-8d10-51b5dbde72ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.671631 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0fa27c0d-8de2-42c7-8d10-51b5dbde72ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.672118 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0fa27c0d-8de2-42c7-8d10-51b5dbde72ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.806784 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0fa27c0d-8de2-42c7-8d10-51b5dbde72ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:03.814653 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0fa27c0d-8de2-42c7-8d10-51b5dbde72ed tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.159723 Jul 24 01:18:03.815193 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 350/680] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:03 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:03.959415 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e50a367e-de49-459b-8f2f-9d653fc46983 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:03.959984 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e50a367e-de49-459b-8f2f-9d653fc46983 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:03.967242 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e50a367e-de49-459b-8f2f-9d653fc46983 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.967717 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e50a367e-de49-459b-8f2f-9d653fc46983 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.968479 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e50a367e-de49-459b-8f2f-9d653fc46983 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.968914 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e50a367e-de49-459b-8f2f-9d653fc46983 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.988492 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:04.109122 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e50a367e-de49-459b-8f2f-9d653fc46983 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:04.116746 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e50a367e-de49-459b-8f2f-9d653fc46983 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.164190 Jul 24 01:18:04.117308 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 331/681] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:03 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:04.231423 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9a9e2fd3-d086-42d5-923c-10753303ddb2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:04.232420 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9a9e2fd3-d086-42d5-923c-10753303ddb2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:04.238909 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9a9e2fd3-d086-42d5-923c-10753303ddb2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:04.239387 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9a9e2fd3-d086-42d5-923c-10753303ddb2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:04.240156 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9a9e2fd3-d086-42d5-923c-10753303ddb2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:04.240676 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9a9e2fd3-d086-42d5-923c-10753303ddb2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:04.275469 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9a9e2fd3-d086-42d5-923c-10753303ddb2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048144 Jul 24 01:18:04.279921 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 351/682] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:18:04 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:04.835979 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9323ab99-b888-4424-a795-097a24770fc3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:04.836588 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9323ab99-b888-4424-a795-097a24770fc3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:04.843144 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9323ab99-b888-4424-a795-097a24770fc3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:04.843621 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9323ab99-b888-4424-a795-097a24770fc3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:04.844377 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9323ab99-b888-4424-a795-097a24770fc3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:04.844812 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9323ab99-b888-4424-a795-097a24770fc3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.028174 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9323ab99-b888-4424-a795-097a24770fc3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:05.036289 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9323ab99-b888-4424-a795-097a24770fc3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.206175 Jul 24 01:18:05.036884 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 332/683] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:04 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:05.134673 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-61f93e83-c3e5-4a78-8299-35082532f68b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:05.135524 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-61f93e83-c3e5-4a78-8299-35082532f68b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:05.144261 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61f93e83-c3e5-4a78-8299-35082532f68b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.144847 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61f93e83-c3e5-4a78-8299-35082532f68b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.145844 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61f93e83-c3e5-4a78-8299-35082532f68b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.146414 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61f93e83-c3e5-4a78-8299-35082532f68b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.284664 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-61f93e83-c3e5-4a78-8299-35082532f68b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:05.288628 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9f226a47-0494-4baf-9052-569d6e1bc9a3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:05.290030 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9f226a47-0494-4baf-9052-569d6e1bc9a3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:05.292930 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-61f93e83-c3e5-4a78-8299-35082532f68b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.162926 Jul 24 01:18:05.293504 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 352/684] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:05 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:05.299465 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9f226a47-0494-4baf-9052-569d6e1bc9a3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.300137 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9f226a47-0494-4baf-9052-569d6e1bc9a3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.301290 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9f226a47-0494-4baf-9052-569d6e1bc9a3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.301929 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9f226a47-0494-4baf-9052-569d6e1bc9a3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.334891 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9f226a47-0494-4baf-9052-569d6e1bc9a3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051296 Jul 24 01:18:05.335666 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 333/685] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:18:05 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:18:05.407685 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6f8372b0-0135-4fc7-b681-93c2abdc666c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:05.408189 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6f8372b0-0135-4fc7-b681-93c2abdc666c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:05.414273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f8372b0-0135-4fc7-b681-93c2abdc666c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.414717 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f8372b0-0135-4fc7-b681-93c2abdc666c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.415510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f8372b0-0135-4fc7-b681-93c2abdc666c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.415942 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f8372b0-0135-4fc7-b681-93c2abdc666c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.441216 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6f8372b0-0135-4fc7-b681-93c2abdc666c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:18:05.476492 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:05.523099 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6f8372b0-0135-4fc7-b681-93c2abdc666c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 204 len: 0 microversion: 2.1 time: 0.119046 Jul 24 01:18:05.523838 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 353/686] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:05 2022] DELETE /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:18:05.532732 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c4bf2774-d32c-4499-97c2-b5eab42a820a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:05.533341 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c4bf2774-d32c-4499-97c2-b5eab42a820a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:05.539506 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c4bf2774-d32c-4499-97c2-b5eab42a820a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.539948 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c4bf2774-d32c-4499-97c2-b5eab42a820a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.540702 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c4bf2774-d32c-4499-97c2-b5eab42a820a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.541131 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c4bf2774-d32c-4499-97c2-b5eab42a820a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.685449 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c4bf2774-d32c-4499-97c2-b5eab42a820a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:05.695954 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c4bf2774-d32c-4499-97c2-b5eab42a820a tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1688 microversion: 2.1 time: 0.167160 Jul 24 01:18:05.696517 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 334/687] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:05 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:06.054519 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5dc754ba-7e33-4363-8afd-73fb696e7fb5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:06.055248 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-5dc754ba-7e33-4363-8afd-73fb696e7fb5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:06.057186 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:06.057857 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=12 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:06.064058 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5dc754ba-7e33-4363-8afd-73fb696e7fb5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.064501 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5dc754ba-7e33-4363-8afd-73fb696e7fb5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.065284 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5dc754ba-7e33-4363-8afd-73fb696e7fb5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.065715 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5dc754ba-7e33-4363-8afd-73fb696e7fb5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.200035 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-5dc754ba-7e33-4363-8afd-73fb696e7fb5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:06.209069 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5dc754ba-7e33-4363-8afd-73fb696e7fb5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.158877 Jul 24 01:18:06.209729 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 354/688] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:06 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:06.310467 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d33f61eb-0061-4321-ae8e-fd1ef1f6ba82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:06.311167 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d33f61eb-0061-4321-ae8e-fd1ef1f6ba82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:06.313167 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=8 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:06.319565 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d33f61eb-0061-4321-ae8e-fd1ef1f6ba82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.320014 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d33f61eb-0061-4321-ae8e-fd1ef1f6ba82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.320796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d33f61eb-0061-4321-ae8e-fd1ef1f6ba82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.321230 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d33f61eb-0061-4321-ae8e-fd1ef1f6ba82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.455598 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d33f61eb-0061-4321-ae8e-fd1ef1f6ba82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:06.463772 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d33f61eb-0061-4321-ae8e-fd1ef1f6ba82 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.157188 Jul 24 01:18:06.464340 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 335/689] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:06 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:06.714715 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f1e7ce3b-d209-431d-a43f-7beb80a2e65e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:06.715473 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f1e7ce3b-d209-431d-a43f-7beb80a2e65e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:06.724377 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1e7ce3b-d209-431d-a43f-7beb80a2e65e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.724926 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1e7ce3b-d209-431d-a43f-7beb80a2e65e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.726056 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1e7ce3b-d209-431d-a43f-7beb80a2e65e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.726815 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1e7ce3b-d209-431d-a43f-7beb80a2e65e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.855639 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f1e7ce3b-d209-431d-a43f-7beb80a2e65e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:06.863530 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f1e7ce3b-d209-431d-a43f-7beb80a2e65e tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1688 microversion: 2.1 time: 0.153533 Jul 24 01:18:06.864090 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 355/690] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:06 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:07.226226 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d5d0564f-e763-40e6-b5f1-db964f87aa02 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:07.226900 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d5d0564f-e763-40e6-b5f1-db964f87aa02 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:07.233229 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d5d0564f-e763-40e6-b5f1-db964f87aa02 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.233675 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d5d0564f-e763-40e6-b5f1-db964f87aa02 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:07.234429 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d5d0564f-e763-40e6-b5f1-db964f87aa02 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.234858 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d5d0564f-e763-40e6-b5f1-db964f87aa02 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:07.381059 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d5d0564f-e763-40e6-b5f1-db964f87aa02 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:07.388862 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d5d0564f-e763-40e6-b5f1-db964f87aa02 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.166576 Jul 24 01:18:07.389433 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 336/691] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:07 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:07.484895 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-264b5aa3-572e-47eb-b93f-668d1f437ed7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:07.485703 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-264b5aa3-572e-47eb-b93f-668d1f437ed7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:07.496776 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-264b5aa3-572e-47eb-b93f-668d1f437ed7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.497540 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-264b5aa3-572e-47eb-b93f-668d1f437ed7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:07.498885 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-264b5aa3-572e-47eb-b93f-668d1f437ed7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.499523 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-264b5aa3-572e-47eb-b93f-668d1f437ed7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:07.646970 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-264b5aa3-572e-47eb-b93f-668d1f437ed7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:07.655598 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-264b5aa3-572e-47eb-b93f-668d1f437ed7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.177122 Jul 24 01:18:07.656144 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 356/692] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:07 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:07.881105 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4f182602-d7a4-461f-b0b0-cbcd8d6460c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:07.881719 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4f182602-d7a4-461f-b0b0-cbcd8d6460c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:07.887906 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f182602-d7a4-461f-b0b0-cbcd8d6460c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.888341 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f182602-d7a4-461f-b0b0-cbcd8d6460c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:07.889100 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f182602-d7a4-461f-b0b0-cbcd8d6460c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.889532 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f182602-d7a4-461f-b0b0-cbcd8d6460c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.036849 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4f182602-d7a4-461f-b0b0-cbcd8d6460c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:08.045132 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4f182602-d7a4-461f-b0b0-cbcd8d6460c6 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1688 microversion: 2.1 time: 0.168082 Jul 24 01:18:08.045697 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 337/693] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:07 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:08.406582 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-412cdd85-6872-4f40-afba-0abfc1a460ba tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:08.407243 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-412cdd85-6872-4f40-afba-0abfc1a460ba tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:08.413755 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-412cdd85-6872-4f40-afba-0abfc1a460ba tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.414210 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-412cdd85-6872-4f40-afba-0abfc1a460ba tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.415000 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-412cdd85-6872-4f40-afba-0abfc1a460ba tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.415562 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-412cdd85-6872-4f40-afba-0abfc1a460ba tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.471126 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-ce9b6143-821a-400d-8ef2-3ca276adf2c5 req-fa3741a1-7060-4d9d-969e-c1729af98754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4800d3-ad11-46dd-90db-b763e1944b9e", "name": "network-vif-plugged", "status": "completed", "tag": "a4e927a5-ea6b-4827-aa7b-42a260b70350"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:08.481150 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-ce9b6143-821a-400d-8ef2-3ca276adf2c5 req-fa3741a1-7060-4d9d-969e-c1729af98754 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.481584 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-ce9b6143-821a-400d-8ef2-3ca276adf2c5 req-fa3741a1-7060-4d9d-969e-c1729af98754 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.495531 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-ce9b6143-821a-400d-8ef2-3ca276adf2c5 req-fa3741a1-7060-4d9d-969e-c1729af98754 service nova] Creating event network-vif-plugged:a4e927a5-ea6b-4827-aa7b-42a260b70350 for instance cb4800d3-ad11-46dd-90db-b763e1944b9e on hv-cinder-maste Jul 24 01:18:08.505123 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-ce9b6143-821a-400d-8ef2-3ca276adf2c5 req-fa3741a1-7060-4d9d-969e-c1729af98754 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038322 Jul 24 01:18:08.505999 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 338/694] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:08.553778 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-412cdd85-6872-4f40-afba-0abfc1a460ba tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:08.562054 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-412cdd85-6872-4f40-afba-0abfc1a460ba tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1362 microversion: 2.1 time: 0.159322 Jul 24 01:18:08.569837 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 357/695] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:08 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:08.676850 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-09162394-06ca-48cd-875d-acbe641e5e1e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:08.677917 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-09162394-06ca-48cd-875d-acbe641e5e1e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:08.688316 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-09162394-06ca-48cd-875d-acbe641e5e1e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.688779 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-09162394-06ca-48cd-875d-acbe641e5e1e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.689545 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-09162394-06ca-48cd-875d-acbe641e5e1e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.689977 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-09162394-06ca-48cd-875d-acbe641e5e1e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.835659 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-09162394-06ca-48cd-875d-acbe641e5e1e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:08.843593 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-09162394-06ca-48cd-875d-acbe641e5e1e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.173794 Jul 24 01:18:08.844212 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 339/696] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:08 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:09.062399 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-23813a0f-8b68-4aaa-8315-7e58eb917381 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:09.062998 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-23813a0f-8b68-4aaa-8315-7e58eb917381 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:09.069702 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-23813a0f-8b68-4aaa-8315-7e58eb917381 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:09.070081 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-23813a0f-8b68-4aaa-8315-7e58eb917381 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:09.070877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-23813a0f-8b68-4aaa-8315-7e58eb917381 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:09.071323 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-23813a0f-8b68-4aaa-8315-7e58eb917381 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:09.205021 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-23813a0f-8b68-4aaa-8315-7e58eb917381 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:09.212661 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-23813a0f-8b68-4aaa-8315-7e58eb917381 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1688 microversion: 2.1 time: 0.154487 Jul 24 01:18:09.213221 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 358/697] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:09 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:09.580336 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5fb8c3b4-49ea-495a-815b-2aaa72b07a94 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:09.581027 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5fb8c3b4-49ea-495a-815b-2aaa72b07a94 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:09.588049 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5fb8c3b4-49ea-495a-815b-2aaa72b07a94 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:09.588490 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5fb8c3b4-49ea-495a-815b-2aaa72b07a94 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:09.589247 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5fb8c3b4-49ea-495a-815b-2aaa72b07a94 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:09.589674 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5fb8c3b4-49ea-495a-815b-2aaa72b07a94 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:09.724618 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5fb8c3b4-49ea-495a-815b-2aaa72b07a94 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:09.732746 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5fb8c3b4-49ea-495a-815b-2aaa72b07a94 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1547 microversion: 2.1 time: 0.156815 Jul 24 01:18:09.733298 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 340/698] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:09 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:09.750136 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4bbdfcc7-cf2a-46ac-b242-e8cf62b22a7e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:09.751136 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4bbdfcc7-cf2a-46ac-b242-e8cf62b22a7e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:09.758148 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4bbdfcc7-cf2a-46ac-b242-e8cf62b22a7e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:09.758590 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4bbdfcc7-cf2a-46ac-b242-e8cf62b22a7e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:09.759368 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4bbdfcc7-cf2a-46ac-b242-e8cf62b22a7e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:09.760013 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4bbdfcc7-cf2a-46ac-b242-e8cf62b22a7e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:09.856024 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4bbdfcc7-cf2a-46ac-b242-e8cf62b22a7e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110323 Jul 24 01:18:09.858692 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 359/699] 10.222.0.42 () {58 vars in 1274 bytes} [Sun Jul 24 01:18:09 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:09.862581 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-28f79a3b-7b60-4946-82e4-e5a0a22e7043 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:09.863221 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-28f79a3b-7b60-4946-82e4-e5a0a22e7043 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:09.869626 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-28f79a3b-7b60-4946-82e4-e5a0a22e7043 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:09.870063 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-28f79a3b-7b60-4946-82e4-e5a0a22e7043 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:09.870912 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-28f79a3b-7b60-4946-82e4-e5a0a22e7043 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:09.871628 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-28f79a3b-7b60-4946-82e4-e5a0a22e7043 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.137512 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-28f79a3b-7b60-4946-82e4-e5a0a22e7043 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:10.147554 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-28f79a3b-7b60-4946-82e4-e5a0a22e7043 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.290614 Jul 24 01:18:10.148476 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 341/700] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:09 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:10.229930 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d151062e-8731-4fdb-901e-200852200988 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:10.230539 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d151062e-8731-4fdb-901e-200852200988 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:10.236792 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d151062e-8731-4fdb-901e-200852200988 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.237251 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d151062e-8731-4fdb-901e-200852200988 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.238027 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d151062e-8731-4fdb-901e-200852200988 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.238465 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d151062e-8731-4fdb-901e-200852200988 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.330604 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d151062e-8731-4fdb-901e-200852200988 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:10.338408 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d151062e-8731-4fdb-901e-200852200988 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1620 microversion: 2.1 time: 0.112426 Jul 24 01:18:10.347797 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 360/701] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:10 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1620 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:10.637209 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-4b587043-296a-408d-95c5-c725c3939e57 req-4e05f42d-a2a3-43eb-b706-b8f5d2e1570b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d614ca48-40f2-4927-a2a9-65a14f2fe0a1", "name": "network-vif-deleted", "tag": "f6ef1157-8359-4903-8874-ba4b3c99bee5"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:10.646234 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-4b587043-296a-408d-95c5-c725c3939e57 req-4e05f42d-a2a3-43eb-b706-b8f5d2e1570b service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.646817 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-4b587043-296a-408d-95c5-c725c3939e57 req-4e05f42d-a2a3-43eb-b706-b8f5d2e1570b service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.662052 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-4b587043-296a-408d-95c5-c725c3939e57 req-4e05f42d-a2a3-43eb-b706-b8f5d2e1570b service nova] Creating event network-vif-deleted:f6ef1157-8359-4903-8874-ba4b3c99bee5 for instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 on hv-cinder-maste Jul 24 01:18:10.669851 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-4b587043-296a-408d-95c5-c725c3939e57 req-4e05f42d-a2a3-43eb-b706-b8f5d2e1570b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098958 Jul 24 01:18:10.671384 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 342/702] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:18:11.164778 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1fa8f4fa-d38e-4428-b6ba-9b82afb134a7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:11.165580 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1fa8f4fa-d38e-4428-b6ba-9b82afb134a7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:11.172831 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1fa8f4fa-d38e-4428-b6ba-9b82afb134a7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.173933 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1fa8f4fa-d38e-4428-b6ba-9b82afb134a7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.174966 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1fa8f4fa-d38e-4428-b6ba-9b82afb134a7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.175829 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1fa8f4fa-d38e-4428-b6ba-9b82afb134a7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.222008 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-8cceb8d5-ed31-4c40-ab1c-b00861ab3c87 req-3e00c2e3-441d-4379-bd5a-1086f96a17ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bec98a72-8d97-4a98-80b3-f5d0a6adce26", "tag": "bd7d30c1-3271-400d-a012-93da64c9b5f7"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:11.232491 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-8cceb8d5-ed31-4c40-ab1c-b00861ab3c87 req-3e00c2e3-441d-4379-bd5a-1086f96a17ff service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.233498 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-8cceb8d5-ed31-4c40-ab1c-b00861ab3c87 req-3e00c2e3-441d-4379-bd5a-1086f96a17ff service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.252366 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-8cceb8d5-ed31-4c40-ab1c-b00861ab3c87 req-3e00c2e3-441d-4379-bd5a-1086f96a17ff service nova] Creating event network-changed:bd7d30c1-3271-400d-a012-93da64c9b5f7 for instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 on hv-cinder-maste Jul 24 01:18:11.264860 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-8cceb8d5-ed31-4c40-ab1c-b00861ab3c87 req-3e00c2e3-441d-4379-bd5a-1086f96a17ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046791 Jul 24 01:18:11.265705 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 343/703] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:18:11.339113 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1fa8f4fa-d38e-4428-b6ba-9b82afb134a7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:11.348785 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1fa8f4fa-d38e-4428-b6ba-9b82afb134a7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1259 microversion: 2.1 time: 0.187951 Jul 24 01:18:11.349514 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 361/704] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:11 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:11.356568 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:11.357560 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:11.364388 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.364906 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.365739 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.366230 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.398361 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.398803 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.399245 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lazy-loading 'fault' on Instance uuid d614ca48-40f2-4927-a2a9-65a14f2fe0a1 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:11.452737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:11.460840 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-4f9150ad-0fac-4e56-a17b-493c6a4f4af3 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 200 len: 1335 microversion: 2.1 time: 0.108407 Jul 24 01:18:11.461417 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 344/705] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:11 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:12.365977 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-46f66569-a574-4adc-ac51-eaddcda2559f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:12.366674 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-46f66569-a574-4adc-ac51-eaddcda2559f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:12.374011 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-46f66569-a574-4adc-ac51-eaddcda2559f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:12.374454 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-46f66569-a574-4adc-ac51-eaddcda2559f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.375201 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-46f66569-a574-4adc-ac51-eaddcda2559f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:12.375656 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-46f66569-a574-4adc-ac51-eaddcda2559f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.478478 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:12.479074 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: d614ca48-40f2-4927-a2a9-65a14f2fe0a1] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:12.485469 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:12.486164 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.487092 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:12.487571 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.502145 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] HTTP exception thrown: Instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 could not be found. Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Request method failure captured: Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 HTTP/1.1 Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxbBq9RVOOhAQ73ZKUuIqeXwuUdZQ3d1dWMBcEkPotAb7wLy9XlKWYf72M40cfFegazXTvNtPJ8Z7wmHfV5zleuIgL43UdUa2qMmm6xuf7JGQq2AZ7GTTqkxHJw3b_LE77Y5xI5GjCIRLWZCBl92MrXAU_Lu8PTGOWaycH1l53LR94 Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:18:12.503885 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55d33269082642989cbc18c052f07b94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55d33269082642989cbc18c052f07b94", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}] Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 1b8154ce6b6b40b4959bf354ccb5c59d Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 could not be found. Jul 24 01:18:12.505379 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'd614ca48-40f2-4927-a2a9-65a14f2fe0a1'} Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 could not be found. Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:12.506285 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 could not be found. Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 could not be found. Jul 24 01:18:12.507964 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:12.509340 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Returning 404 to user: Instance d614ca48-40f2-4927-a2a9-65a14f2fe0a1 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:12.509340 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a1f80b18-10f3-4d65-96a6-5f38282fe4db tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1" status: 404 len: 111 microversion: 2.1 time: 0.031035 Jul 24 01:18:12.509340 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 345/706] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:12 2022] GET /compute/v2.1/servers/d614ca48-40f2-4927-a2a9-65a14f2fe0a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:18:12.513796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-953ee29f-721a-48d3-9552-2b52a8187eb2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '.version_select at 0x7fdf3c0c53a0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:12.516391 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-46f66569-a574-4adc-ac51-eaddcda2559f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:12.525294 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-46f66569-a574-4adc-ac51-eaddcda2559f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1444 microversion: 2.1 time: 0.163433 Jul 24 01:18:12.526049 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 362/707] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:12 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:12.531708 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-953ee29f-721a-48d3-9552-2b52a8187eb2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-364310927" status: 202 len: 0 microversion: 2.1 time: 0.021379 Jul 24 01:18:12.532265 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 346/708] 10.222.0.42 () {58 vars in 1217 bytes} [Sun Jul 24 01:18:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-364310927 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:18:12.541359 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-58465323-9027-4da3-a498-610756108ff6 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:12.541973 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-58465323-9027-4da3-a498-610756108ff6 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:12.547968 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-58465323-9027-4da3-a498-610756108ff6 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:12.548771 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-58465323-9027-4da3-a498-610756108ff6 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.549521 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-58465323-9027-4da3-a498-610756108ff6 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:12.549948 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-58465323-9027-4da3-a498-610756108ff6 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.841851 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-58465323-9027-4da3-a498-610756108ff6 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:12.849320 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-58465323-9027-4da3-a498-610756108ff6 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1444 microversion: 2.1 time: 0.311745 Jul 24 01:18:12.849952 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 363/709] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:12 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1444 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:14.542918 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-80fb2f64-38f2-4f0b-a98a-6c0eac6e3c42 req-7f5a29b0-06f5-43b0-a94d-ee291dcdfe86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4800d3-ad11-46dd-90db-b763e1944b9e", "tag": "a4e927a5-ea6b-4827-aa7b-42a260b70350"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:14.553253 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-80fb2f64-38f2-4f0b-a98a-6c0eac6e3c42 req-7f5a29b0-06f5-43b0-a94d-ee291dcdfe86 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:14.553694 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-80fb2f64-38f2-4f0b-a98a-6c0eac6e3c42 req-7f5a29b0-06f5-43b0-a94d-ee291dcdfe86 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:14.565332 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-80fb2f64-38f2-4f0b-a98a-6c0eac6e3c42 req-7f5a29b0-06f5-43b0-a94d-ee291dcdfe86 service nova] Creating event network-changed:a4e927a5-ea6b-4827-aa7b-42a260b70350 for instance cb4800d3-ad11-46dd-90db-b763e1944b9e on hv-cinder-maste Jul 24 01:18:14.570881 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-80fb2f64-38f2-4f0b-a98a-6c0eac6e3c42 req-7f5a29b0-06f5-43b0-a94d-ee291dcdfe86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031626 Jul 24 01:18:14.571908 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 347/710] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:15.673661 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3e9ed92a-3c35-47c4-b296-c8ae961beb4c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:15.674185 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3e9ed92a-3c35-47c4-b296-c8ae961beb4c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:15.681138 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3e9ed92a-3c35-47c4-b296-c8ae961beb4c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:15.681649 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3e9ed92a-3c35-47c4-b296-c8ae961beb4c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:15.682381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3e9ed92a-3c35-47c4-b296-c8ae961beb4c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:15.682807 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3e9ed92a-3c35-47c4-b296-c8ae961beb4c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:15.707660 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3e9ed92a-3c35-47c4-b296-c8ae961beb4c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:18:15.773419 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:15.789676 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3e9ed92a-3c35-47c4-b296-c8ae961beb4c tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 204 len: 0 microversion: 2.1 time: 0.120041 Jul 24 01:18:15.790255 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 364/711] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:15 2022] DELETE /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:18:15.801808 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-142a6221-8e2a-4a14-9e81-dd8a5065c541 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:15.802496 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-142a6221-8e2a-4a14-9e81-dd8a5065c541 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:15.805757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:15.809831 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-142a6221-8e2a-4a14-9e81-dd8a5065c541 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:15.810272 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-142a6221-8e2a-4a14-9e81-dd8a5065c541 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:15.811023 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-142a6221-8e2a-4a14-9e81-dd8a5065c541 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:15.811488 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-142a6221-8e2a-4a14-9e81-dd8a5065c541 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:15.944726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-142a6221-8e2a-4a14-9e81-dd8a5065c541 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:15.956060 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-142a6221-8e2a-4a14-9e81-dd8a5065c541 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1508 microversion: 2.1 time: 0.159187 Jul 24 01:18:15.956730 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 348/712] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:15 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:16.978631 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e5197149-952a-4adf-9526-0b0e198dc914 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:16.979690 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e5197149-952a-4adf-9526-0b0e198dc914 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:16.987706 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e5197149-952a-4adf-9526-0b0e198dc914 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:16.988155 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e5197149-952a-4adf-9526-0b0e198dc914 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:16.988927 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e5197149-952a-4adf-9526-0b0e198dc914 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:16.989357 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e5197149-952a-4adf-9526-0b0e198dc914 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:17.140557 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e5197149-952a-4adf-9526-0b0e198dc914 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:17.148975 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e5197149-952a-4adf-9526-0b0e198dc914 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1508 microversion: 2.1 time: 0.176879 Jul 24 01:18:17.149890 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 365/713] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:16 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:17.920480 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-18a39fda-a455-47b7-858b-11f382225f79 req-e4342ac1-471c-44d1-a438-ab90ceca206c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da53513-cfab-4dee-9c4a-e9f3840a73d4", "name": "network-vif-deleted", "tag": "a3dad938-ab34-4d5f-baea-de05eaf232c6"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:17.930231 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-18a39fda-a455-47b7-858b-11f382225f79 req-e4342ac1-471c-44d1-a438-ab90ceca206c service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:17.930686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-18a39fda-a455-47b7-858b-11f382225f79 req-e4342ac1-471c-44d1-a438-ab90ceca206c service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:17.942416 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-18a39fda-a455-47b7-858b-11f382225f79 req-e4342ac1-471c-44d1-a438-ab90ceca206c service nova] Creating event network-vif-deleted:a3dad938-ab34-4d5f-baea-de05eaf232c6 for instance 6da53513-cfab-4dee-9c4a-e9f3840a73d4 on hv-cinder-maste Jul 24 01:18:17.946698 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-18a39fda-a455-47b7-858b-11f382225f79 req-e4342ac1-471c-44d1-a438-ab90ceca206c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029808 Jul 24 01:18:17.947637 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 349/714] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:18.166289 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:18.166855 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:18.174125 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.174567 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.175339 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.175782 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.207999 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.208456 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.208890 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lazy-loading 'fault' on Instance uuid 6da53513-cfab-4dee-9c4a-e9f3840a73d4 {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:18.251679 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:18.259738 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a1ec3f4c-606f-479e-9bf5-1d76de0c69d7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 200 len: 1312 microversion: 2.1 time: 0.097399 Jul 24 01:18:18.260397 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 366/715] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:18 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:19.278064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:19.278755 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 6da53513-cfab-4dee-9c4a-e9f3840a73d4] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:19.285689 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:19.286133 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:19.286895 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:19.287323 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:19.301194 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] HTTP exception thrown: Instance 6da53513-cfab-4dee-9c4a-e9f3840a73d4 could not be found. Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Request method failure captured: Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 HTTP/1.1 Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxbBq9RVOOhAQ73ZKUuIqeXwuUdZQ3d1dWMBcEkPotAb7wLy9XlKWYf72M40cfFegazXTvNtPJ8Z7wmHfV5zleuIgL43UdUa2qMmm6xuf7JGQq2AZ7GTTqkxHJw3b_LE77Y5xI5GjCIRLWZCBl92MrXAU_Lu8PTGOWaycH1l53LR94 Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:18:19.302773 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55d33269082642989cbc18c052f07b94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55d33269082642989cbc18c052f07b94", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}] Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 1b8154ce6b6b40b4959bf354ccb5c59d Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 6da53513-cfab-4dee-9c4a-e9f3840a73d4 could not be found. Jul 24 01:18:19.304471 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '6da53513-cfab-4dee-9c4a-e9f3840a73d4'} Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da53513-cfab-4dee-9c4a-e9f3840a73d4 could not be found. Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:19.305467 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da53513-cfab-4dee-9c4a-e9f3840a73d4 could not be found. Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da53513-cfab-4dee-9c4a-e9f3840a73d4 could not be found. Jul 24 01:18:19.307015 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:18:19.309171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Returning 404 to user: Instance 6da53513-cfab-4dee-9c4a-e9f3840a73d4 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:19.309171 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-012402c3-54b2-4a09-b98c-780571c6e4b2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4" status: 404 len: 111 microversion: 2.1 time: 0.030957 Jul 24 01:18:19.309171 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 350/716] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:19 2022] GET /compute/v2.1/servers/6da53513-cfab-4dee-9c4a-e9f3840a73d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:19.317416 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-116e3ec3-5fef-42b4-9fb6-ea4fd52133ef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:19.318058 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-116e3ec3-5fef-42b4-9fb6-ea4fd52133ef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:19.325770 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-116e3ec3-5fef-42b4-9fb6-ea4fd52133ef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:19.326246 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-116e3ec3-5fef-42b4-9fb6-ea4fd52133ef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:19.327009 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-116e3ec3-5fef-42b4-9fb6-ea4fd52133ef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:19.327474 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-116e3ec3-5fef-42b4-9fb6-ea4fd52133ef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:19.352823 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-116e3ec3-5fef-42b4-9fb6-ea4fd52133ef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:18:19.366227 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:19.428781 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-116e3ec3-5fef-42b4-9fb6-ea4fd52133ef tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 204 len: 0 microversion: 2.1 time: 0.117272 Jul 24 01:18:19.429362 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 367/717] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:19 2022] DELETE /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:18:19.440174 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5ea3ab19-daa8-480d-ab3a-f3005a0ca4b7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:19.440796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5ea3ab19-daa8-480d-ab3a-f3005a0ca4b7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:19.447487 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5ea3ab19-daa8-480d-ab3a-f3005a0ca4b7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:19.447943 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5ea3ab19-daa8-480d-ab3a-f3005a0ca4b7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:19.448702 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5ea3ab19-daa8-480d-ab3a-f3005a0ca4b7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:19.449134 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5ea3ab19-daa8-480d-ab3a-f3005a0ca4b7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:19.608841 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5ea3ab19-daa8-480d-ab3a-f3005a0ca4b7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:19.616713 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5ea3ab19-daa8-480d-ab3a-f3005a0ca4b7 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.180847 Jul 24 01:18:19.617326 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 351/718] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:19 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:20.640821 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7f25306f-967c-4eeb-9c0e-56df035adfab tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:20.641515 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7f25306f-967c-4eeb-9c0e-56df035adfab tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:20.648223 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7f25306f-967c-4eeb-9c0e-56df035adfab tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:20.648700 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7f25306f-967c-4eeb-9c0e-56df035adfab tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:20.649453 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7f25306f-967c-4eeb-9c0e-56df035adfab tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:20.649886 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7f25306f-967c-4eeb-9c0e-56df035adfab tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:20.786006 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7f25306f-967c-4eeb-9c0e-56df035adfab tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:20.793745 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7f25306f-967c-4eeb-9c0e-56df035adfab tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.157284 Jul 24 01:18:20.794281 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 368/719] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:20 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:21.811638 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f6844c99-af0f-4e13-9e44-79494d410aa2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:21.812305 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f6844c99-af0f-4e13-9e44-79494d410aa2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:21.819407 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f6844c99-af0f-4e13-9e44-79494d410aa2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:21.819854 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f6844c99-af0f-4e13-9e44-79494d410aa2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:21.820617 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f6844c99-af0f-4e13-9e44-79494d410aa2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:21.821058 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f6844c99-af0f-4e13-9e44-79494d410aa2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:21.950403 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f6844c99-af0f-4e13-9e44-79494d410aa2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:21.958987 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f6844c99-af0f-4e13-9e44-79494d410aa2 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1520 microversion: 2.1 time: 0.150900 Jul 24 01:18:21.960007 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 352/720] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:21 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:22.502542 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-20598f8f-80d9-441b-b25b-3fcddef38537 req-e71591dd-7db4-4751-81de-2df6a4615a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266d103a-6114-42ba-a840-13096deab642", "name": "network-vif-deleted", "tag": "e5f7c4ed-65a6-4029-84af-705b8d828f64"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:22.512423 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-20598f8f-80d9-441b-b25b-3fcddef38537 req-e71591dd-7db4-4751-81de-2df6a4615a10 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:22.512888 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-20598f8f-80d9-441b-b25b-3fcddef38537 req-e71591dd-7db4-4751-81de-2df6a4615a10 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:22.524921 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-20598f8f-80d9-441b-b25b-3fcddef38537 req-e71591dd-7db4-4751-81de-2df6a4615a10 service nova] Creating event network-vif-deleted:e5f7c4ed-65a6-4029-84af-705b8d828f64 for instance 266d103a-6114-42ba-a840-13096deab642 on hv-cinder-maste Jul 24 01:18:22.529817 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-20598f8f-80d9-441b-b25b-3fcddef38537 req-e71591dd-7db4-4751-81de-2df6a4615a10 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031054 Jul 24 01:18:22.530394 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 369/721] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:22.977526 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:22.978296 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:22.986014 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:22.986455 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:22.987516 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:22.987838 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:23.006399 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=100 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:23.020927 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:23.021290 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:23.021732 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lazy-loading 'fault' on Instance uuid 266d103a-6114-42ba-a840-13096deab642 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:23.063774 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8154ce6b6b40b4959bf354ccb5c59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d33269082642989cbc18c052f07b94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:23.072675 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ee25d648-a6e4-4813-9998-3a87ed314a4f tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 200 len: 1311 microversion: 2.1 time: 0.099313 Jul 24 01:18:23.073257 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 353/722] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:22 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:24.100672 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:24.101862 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] [instance: 266d103a-6114-42ba-a840-13096deab642] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:24.112865 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:24.113577 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:24.115242 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:24.115983 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:24.131423 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] HTTP exception thrown: Instance 266d103a-6114-42ba-a840-13096deab642 could not be found. Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Request method failure captured: Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 HTTP/1.1 Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxbBq9RVOOhAQ73ZKUuIqeXwuUdZQ3d1dWMBcEkPotAb7wLy9XlKWYf72M40cfFegazXTvNtPJ8Z7wmHfV5zleuIgL43UdUa2qMmm6xuf7JGQq2AZ7GTTqkxHJw3b_LE77Y5xI5GjCIRLWZCBl92MrXAU_Lu8PTGOWaycH1l53LR94 Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:18:24.133078 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/55d33269082642989cbc18c052f07b94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_55d33269082642989cbc18c052f07b94", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/55d33269082642989cbc18c052f07b94"}]}] Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 55d33269082642989cbc18c052f07b94 Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168686961 Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1b8154ce6b6b40b4959bf354ccb5c59d Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168686961-project Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 266d103a-6114-42ba-a840-13096deab642 could not be found. Jul 24 01:18:24.134562 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '266d103a-6114-42ba-a840-13096deab642'} Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 266d103a-6114-42ba-a840-13096deab642 could not be found. Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:24.135511 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 266d103a-6114-42ba-a840-13096deab642 could not be found. Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 266d103a-6114-42ba-a840-13096deab642 could not be found. Jul 24 01:18:24.137088 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:24.138428 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] Returning 404 to user: Instance 266d103a-6114-42ba-a840-13096deab642 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:24.138428 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-35bf5a3e-3bb5-4d96-a28e-171f22e76c90 tempest-ServerRescueNegativeTestJSON-168686961 tempest-ServerRescueNegativeTestJSON-168686961-project] 10.222.0.42 "GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642" status: 404 len: 111 microversion: 2.1 time: 0.042064 Jul 24 01:18:24.138428 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 370/723] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:24 2022] GET /compute/v2.1/servers/266d103a-6114-42ba-a840-13096deab642 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:32.609134 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-20e6e593-5927-4583-8b5c-5eddf53a3670 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'create', calling method: .version_select at 0x7fdf3c389040>, body: {"keypair": {"name": "tempest-keypair-818986989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMt31W2nTTe18CvNue9m5HsGEC1a3BwDmoJhEwe5YVWCO+fG7811/2tsjgt89anUbvLQ3Y3GEqhRXau6gvjPK6yDr7BsQRbLqF5yjZ8G/+Qsy4hPjm2x6EM6RV02/+16w=="}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:32.623518 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-20e6e593-5927-4583-8b5c-5eddf53a3670 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Getting quotas for project 013fccf2797345bf95efcafd089dfcf1. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:32.627624 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-20e6e593-5927-4583-8b5c-5eddf53a3670 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Getting quotas for user fe042f088ffb4b7db88cafe05b11808c and project 013fccf2797345bf95efcafd089dfcf1. Resources: {'key_pairs'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:32.652670 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-20e6e593-5927-4583-8b5c-5eddf53a3670 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.190079 Jul 24 01:18:32.653280 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 354/724] 10.222.0.42 () {62 vars in 1199 bytes} [Sun Jul 24 01:18:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:18:33.942499 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1042209561", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f17bb821-e143-452a-ba5a-d6f407514d96"}], "security_groups": [{"name": "tempest-securitygroup--875564960"}], "key_name": "tempest-keypair-818986989", "user_data": "}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:34.051213 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.network.neutron [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] validate_networks() for [('f17bb821-e143-452a-ba5a-d6f407514d96', None, None, None, None, None)] {{(pid=118035) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:18:34.122025 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:34.430382 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Flavor limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:18:34.430828 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Image limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:18:34.431322 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Flavor pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:18:34.431735 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Image pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:18:34.432145 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:18:34.441350 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:34.441818 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:34.442682 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:34.443117 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:34.460058 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Getting quotas for project 013fccf2797345bf95efcafd089dfcf1. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:34.464261 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Getting quotas for user fe042f088ffb4b7db88cafe05b11808c and project 013fccf2797345bf95efcafd089dfcf1. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:34.475026 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Going to run 1 instances... {{(pid=118035) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:18:34.477556 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118035) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:18:34.524270 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9dd6d284-5b6a-4e58-a31e-97c0fe39c6d2 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.586223 Jul 24 01:18:34.524917 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 371/725] 10.222.0.42 () {62 vars in 1187 bytes} [Sun Jul 24 01:18:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:18:34.535016 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-94e79e94-4b52-4947-9ba5-5ea7c0e3651b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:34.535712 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-94e79e94-4b52-4947-9ba5-5ea7c0e3651b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:34.537592 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=4 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:34.591962 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-94e79e94-4b52-4947-9ba5-5ea7c0e3651b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:34.600188 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-94e79e94-4b52-4947-9ba5-5ea7c0e3651b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:34.601737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-94e79e94-4b52-4947-9ba5-5ea7c0e3651b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:34.602870 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-94e79e94-4b52-4947-9ba5-5ea7c0e3651b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1281 microversion: 2.20 time: 0.071795 Jul 24 01:18:34.603492 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 355/726] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:34 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:18:35.620808 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:35.621479 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:35.630129 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:35.630674 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:35.631895 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:35.632362 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:35.700400 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:35.709384 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:35.711941 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:35.713550 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f1d0eb3d-7476-4bcc-bf1a-7f6aaabcb60b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1341 microversion: 2.20 time: 0.097006 Jul 24 01:18:35.714721 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 372/727] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:35 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:36.733258 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:36.734517 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:36.741165 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.741674 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.742686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.743447 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.876325 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:36.884788 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:36.886286 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:36.887431 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-13115b52-4478-4fc0-aabf-f57e8edfa027 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1406 microversion: 2.20 time: 0.158514 Jul 24 01:18:36.887988 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 356/728] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:36 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:37.226143 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-99641fcd-f197-4c44-adff-9f344e871328 req-ce305280-ce90-492d-9102-d670e0256e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77065eb8-1786-49a7-b12a-f672a4ff9d6c", "tag": "55916731-c84b-4d9a-ac1d-58db6f0aed04"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:37.236512 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-99641fcd-f197-4c44-adff-9f344e871328 req-ce305280-ce90-492d-9102-d670e0256e5e service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.239652 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-99641fcd-f197-4c44-adff-9f344e871328 req-ce305280-ce90-492d-9102-d670e0256e5e service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.251657 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-99641fcd-f197-4c44-adff-9f344e871328 req-ce305280-ce90-492d-9102-d670e0256e5e service nova] Creating event network-changed:55916731-c84b-4d9a-ac1d-58db6f0aed04 for instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c on hv-cinder-maste Jul 24 01:18:37.256791 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-99641fcd-f197-4c44-adff-9f344e871328 req-ce305280-ce90-492d-9102-d670e0256e5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040310 Jul 24 01:18:37.257403 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 373/729] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:37.343647 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0b06bf1a-36d1-4ba2-9843-d6bd1bb8e5e8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:37.344172 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0b06bf1a-36d1-4ba2-9843-d6bd1bb8e5e8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:37.350639 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b06bf1a-36d1-4ba2-9843-d6bd1bb8e5e8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.351084 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b06bf1a-36d1-4ba2-9843-d6bd1bb8e5e8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.352127 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b06bf1a-36d1-4ba2-9843-d6bd1bb8e5e8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.352761 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b06bf1a-36d1-4ba2-9843-d6bd1bb8e5e8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.379357 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0b06bf1a-36d1-4ba2-9843-d6bd1bb8e5e8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/ips" status: 200 len: 149 microversion: 2.1 time: 0.039568 Jul 24 01:18:37.380080 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 357/730] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:18:37 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:37.910669 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:37.911860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:37.920556 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.920993 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.921767 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.922206 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.052308 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:38.064822 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:38.067176 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:38.068828 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-406229ab-14c3-4c00-b6e0-f12cd711b0e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1406 microversion: 2.20 time: 0.165158 Jul 24 01:18:38.069617 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 374/731] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:37 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:38.717495 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-14b6fd6e-7390-471a-b28e-5a9567fe2230 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95c50052-78f6-4f31-ade1-3d8afdd2ae8f"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:38.718560 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-14b6fd6e-7390-471a-b28e-5a9567fe2230 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:38.725615 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-14b6fd6e-7390-471a-b28e-5a9567fe2230 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.726051 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-14b6fd6e-7390-471a-b28e-5a9567fe2230 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.726807 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-14b6fd6e-7390-471a-b28e-5a9567fe2230 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.727230 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-14b6fd6e-7390-471a-b28e-5a9567fe2230 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:39.091142 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:39.091763 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:39.099270 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:39.099746 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:39.100518 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:39.100954 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:39.240242 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:39.248695 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:39.250184 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:39.251310 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-68c0f1ea-e6f5-41ac-82ef-88cad7b750e6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1406 microversion: 2.20 time: 0.165879 Jul 24 01:18:39.251897 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 375/732] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:39 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:40.270710 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:40.271757 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:40.278784 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.279468 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.280642 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.281149 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.334487 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-14b6fd6e-7390-471a-b28e-5a9567fe2230 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.620770 Jul 24 01:18:40.335652 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 358/733] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:18:38 2022] POST /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments => generated 194 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:40.425732 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.445096 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.447012 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.448268 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-69eb12d3-ad0e-4da4-91bd-72eec946e107 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1406 microversion: 2.20 time: 0.182539 Jul 24 01:18:40.449141 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 376/734] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:40 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:18:41.467633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:41.468356 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:41.475425 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:41.475871 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:41.476629 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:41.477043 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:41.608363 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:41.616290 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:41.617772 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:41.618915 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5f0dfc20-fb83-4b26-8c89-d9e3c0206c34 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1406 microversion: 2.20 time: 0.156022 Jul 24 01:18:41.619502 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 359/735] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:41 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:42.612445 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95c50052-78f6-4f31-ade1-3d8afdd2ae8f"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:42.613608 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:42.620893 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.621342 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.622332 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.622927 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.635596 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-8fc5dbd4-c03b-4c21-bac5-2ae9ecd0e6ef req-693fd039-d83a-4a12-8920-75b27ebd5278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77065eb8-1786-49a7-b12a-f672a4ff9d6c", "name": "network-vif-plugged", "status": "completed", "tag": "55916731-c84b-4d9a-ac1d-58db6f0aed04"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:42.649803 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-8fc5dbd4-c03b-4c21-bac5-2ae9ecd0e6ef req-693fd039-d83a-4a12-8920-75b27ebd5278 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.650416 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-8fc5dbd4-c03b-4c21-bac5-2ae9ecd0e6ef req-693fd039-d83a-4a12-8920-75b27ebd5278 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.673849 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-8fc5dbd4-c03b-4c21-bac5-2ae9ecd0e6ef req-693fd039-d83a-4a12-8920-75b27ebd5278 service nova] Creating event network-vif-plugged:55916731-c84b-4d9a-ac1d-58db6f0aed04 for instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c on hv-cinder-maste Jul 24 01:18:42.683457 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-8fc5dbd4-c03b-4c21-bac5-2ae9ecd0e6ef req-693fd039-d83a-4a12-8920-75b27ebd5278 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055632 Jul 24 01:18:42.684153 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 360/736] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:42.689784 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:42.690640 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:42.697196 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.697661 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.698422 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.699349 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.722059 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Invalid volume: volume 95c50052-78f6-4f31-ade1-3d8afdd2ae8f is already attached to instances: dc0506b1-88fd-49f6-a2f5-88288c722940 Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: POST /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments HTTP/1.1 Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 74 Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:18:42.724365 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: {"volumeAttachment": {"volumeId": "95c50052-78f6-4f31-ade1-3d8afdd2ae8f"}} Jul 24 01:18:42.726107 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Invalid volume: volume 95c50052-78f6-4f31-ade1-3d8afdd2ae8f is already attached to instances: dc0506b1-88fd-49f6-a2f5-88288c722940 Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'server_id': 'dc0506b1-88fd-49f6-a2f5-88288c722940', 'body': {'volumeAttachment': {'volumeId': '95c50052-78f6-4f31-ade1-3d8afdd2ae8f'}}} Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 95c50052-78f6-4f31-ade1-3d8afdd2ae8f is already attached to instances: dc0506b1-88fd-49f6-a2f5-88288c722940 Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:42.727005 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 95c50052-78f6-4f31-ade1-3d8afdd2ae8f is already attached to instances: dc0506b1-88fd-49f6-a2f5-88288c722940 Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:42.728533 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:42.729975 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:42.729975 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:42.729975 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:42.729975 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 95c50052-78f6-4f31-ade1-3d8afdd2ae8f is already attached to instances: dc0506b1-88fd-49f6-a2f5-88288c722940 Jul 24 01:18:42.729975 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:42.731693 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 400 to user: Invalid volume: volume 95c50052-78f6-4f31-ade1-3d8afdd2ae8f is already attached to instances: dc0506b1-88fd-49f6-a2f5-88288c722940 {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:42.733100 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-89768de3-35a6-4451-83d8-e45ba8123232 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125396 Jul 24 01:18:42.733917 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 377/737] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:18:42 2022] POST /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:18:42.795884 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ff00cfd1-ce35-45cd-a514-ab8e99827b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:42.796381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ff00cfd1-ce35-45cd-a514-ab8e99827b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:42.803016 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ff00cfd1-ce35-45cd-a514-ab8e99827b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.803522 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ff00cfd1-ce35-45cd-a514-ab8e99827b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.804292 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ff00cfd1-ce35-45cd-a514-ab8e99827b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.804726 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ff00cfd1-ce35-45cd-a514-ab8e99827b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.865699 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:42.874037 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:42.876467 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:42.877567 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-33440c40-ea7f-4086-a935-160b4f843753 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1406 microversion: 2.20 time: 0.192100 Jul 24 01:18:42.878121 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 361/738] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:42 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:42.892942 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-ff00cfd1-ce35-45cd-a514-ab8e99827b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lazy-loading 'services' on Instance uuid dc0506b1-88fd-49f6-a2f5-88288c722940 {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:42.966825 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ff00cfd1-ce35-45cd-a514-ab8e99827b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments/95c50052-78f6-4f31-ade1-3d8afdd2ae8f" status: 202 len: 0 microversion: 2.1 time: 0.174763 Jul 24 01:18:42.967431 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 378/739] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:18:42 2022] DELETE /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments/95c50052-78f6-4f31-ade1-3d8afdd2ae8f => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:18:42.975893 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-890ac339-83e7-4e32-9f48-7bf88bfbda2b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:42.976823 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-890ac339-83e7-4e32-9f48-7bf88bfbda2b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:42.982960 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-890ac339-83e7-4e32-9f48-7bf88bfbda2b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.983445 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-890ac339-83e7-4e32-9f48-7bf88bfbda2b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.984190 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-890ac339-83e7-4e32-9f48-7bf88bfbda2b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.984613 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-890ac339-83e7-4e32-9f48-7bf88bfbda2b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:43.012537 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-890ac339-83e7-4e32-9f48-7bf88bfbda2b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040623 Jul 24 01:18:43.013103 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 362/740] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:18:42 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:43.901529 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:43.902574 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:43.913335 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.914136 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:43.915415 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.916161 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:44.024540 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-804f9f67-c330-4786-b1a7-fce7c2b02cb6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:44.025482 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-804f9f67-c330-4786-b1a7-fce7c2b02cb6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:44.032236 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-804f9f67-c330-4786-b1a7-fce7c2b02cb6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:44.032686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-804f9f67-c330-4786-b1a7-fce7c2b02cb6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:44.033439 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-804f9f67-c330-4786-b1a7-fce7c2b02cb6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:44.033870 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-804f9f67-c330-4786-b1a7-fce7c2b02cb6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:44.049990 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:44.058234 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:44.059860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:44.060964 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3bf96baa-705e-4f7f-aa86-85c0b7cff552 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1406 microversion: 2.20 time: 0.167504 Jul 24 01:18:44.061517 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 379/741] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:43 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:44.064306 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-804f9f67-c330-4786-b1a7-fce7c2b02cb6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Jul 24 01:18:44.064862 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 363/742] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:18:44 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:45.079839 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c107ae0b-40f3-42b1-af74-7ec999de0a63 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:45.081063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c107ae0b-40f3-42b1-af74-7ec999de0a63 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:45.082365 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:45.083418 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:45.085271 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:45.086240 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=6 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:45.088017 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=6 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:45.092400 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c107ae0b-40f3-42b1-af74-7ec999de0a63 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.092808 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c107ae0b-40f3-42b1-af74-7ec999de0a63 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.093633 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c107ae0b-40f3-42b1-af74-7ec999de0a63 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.093746 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.094059 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c107ae0b-40f3-42b1-af74-7ec999de0a63 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.094181 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.094877 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.095326 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.124574 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c107ae0b-40f3-42b1-af74-7ec999de0a63 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051131 Jul 24 01:18:45.125508 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 380/743] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:18:45 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:45.230026 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.241610 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.245063 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.248089 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-71a47b00-cc05-4cda-bb1b-01be282d5cd9 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1406 microversion: 2.20 time: 0.172349 Jul 24 01:18:45.249042 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 364/744] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:45 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:46.138588 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9f31cb36-184e-47da-b83a-b4f994d72bd4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:46.139484 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9f31cb36-184e-47da-b83a-b4f994d72bd4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:46.146373 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f31cb36-184e-47da-b83a-b4f994d72bd4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.146822 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f31cb36-184e-47da-b83a-b4f994d72bd4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.147621 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f31cb36-184e-47da-b83a-b4f994d72bd4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.148052 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9f31cb36-184e-47da-b83a-b4f994d72bd4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.178330 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9f31cb36-184e-47da-b83a-b4f994d72bd4 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045090 Jul 24 01:18:46.178876 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 381/745] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:18:46 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:18:46.237678 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3b34f5f7-7f97-4572-bea5-6f539257b89b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:46.238186 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3b34f5f7-7f97-4572-bea5-6f539257b89b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:46.240545 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:46.247327 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3b34f5f7-7f97-4572-bea5-6f539257b89b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.247892 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3b34f5f7-7f97-4572-bea5-6f539257b89b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.248659 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3b34f5f7-7f97-4572-bea5-6f539257b89b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.249091 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3b34f5f7-7f97-4572-bea5-6f539257b89b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.268518 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:46.269116 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:46.274394 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3b34f5f7-7f97-4572-bea5-6f539257b89b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Going to try to terminate instance {{(pid=118036) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:18:46.275704 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.276221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.277005 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.277446 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.355833 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3b34f5f7-7f97-4572-bea5-6f539257b89b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 204 len: 0 microversion: 2.1 time: 0.121551 Jul 24 01:18:46.356903 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 365/746] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:46 2022] DELETE /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:18:46.367258 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-73a9af38-1326-44de-9ba8-f00ced0a631c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:46.367985 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-73a9af38-1326-44de-9ba8-f00ced0a631c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:46.374287 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-73a9af38-1326-44de-9ba8-f00ced0a631c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.374737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-73a9af38-1326-44de-9ba8-f00ced0a631c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.375544 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-73a9af38-1326-44de-9ba8-f00ced0a631c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.375981 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-73a9af38-1326-44de-9ba8-f00ced0a631c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.413634 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:46.422133 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:46.423986 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:46.425166 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9114bdba-ca0e-4296-9161-b25493b43034 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1598 microversion: 2.20 time: 0.160667 Jul 24 01:18:46.425689 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 382/747] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:46 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:18:46.442343 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-dcab22de-31fc-4921-82b6-64c734702bf7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:46.442857 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-dcab22de-31fc-4921-82b6-64c734702bf7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:46.449226 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dcab22de-31fc-4921-82b6-64c734702bf7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.449954 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dcab22de-31fc-4921-82b6-64c734702bf7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.450764 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dcab22de-31fc-4921-82b6-64c734702bf7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.451200 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dcab22de-31fc-4921-82b6-64c734702bf7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.545145 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-dcab22de-31fc-4921-82b6-64c734702bf7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106494 Jul 24 01:18:46.545745 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 383/748] 10.222.0.42 () {60 vars in 1315 bytes} [Sun Jul 24 01:18:46 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:18:46.550430 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-73a9af38-1326-44de-9ba8-f00ced0a631c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:46.560857 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-73a9af38-1326-44de-9ba8-f00ced0a631c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1679 microversion: 2.1 time: 0.199059 Jul 24 01:18:46.561613 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 366/749] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:46 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:47.460722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-bf21b18a-d531-465a-9e3f-131e4773b056 req-8038ebd5-0bf4-4fdc-8725-62399e12cea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77065eb8-1786-49a7-b12a-f672a4ff9d6c", "tag": "55916731-c84b-4d9a-ac1d-58db6f0aed04"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:47.464275 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:47.469961 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-bf21b18a-d531-465a-9e3f-131e4773b056 req-8038ebd5-0bf4-4fdc-8725-62399e12cea5 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.470397 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-bf21b18a-d531-465a-9e3f-131e4773b056 req-8038ebd5-0bf4-4fdc-8725-62399e12cea5 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.482785 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-bf21b18a-d531-465a-9e3f-131e4773b056 req-8038ebd5-0bf4-4fdc-8725-62399e12cea5 service nova] Creating event network-changed:55916731-c84b-4d9a-ac1d-58db6f0aed04 for instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c on hv-cinder-maste Jul 24 01:18:47.487934 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-bf21b18a-d531-465a-9e3f-131e4773b056 req-8038ebd5-0bf4-4fdc-8725-62399e12cea5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031349 Jul 24 01:18:47.488509 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 384/750] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:47.579565 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e59b6fbb-ba64-489d-9680-b4e5ac76b8b0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:47.580109 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e59b6fbb-ba64-489d-9680-b4e5ac76b8b0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:47.587090 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e59b6fbb-ba64-489d-9680-b4e5ac76b8b0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.587584 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e59b6fbb-ba64-489d-9680-b4e5ac76b8b0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.588350 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e59b6fbb-ba64-489d-9680-b4e5ac76b8b0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.588781 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e59b6fbb-ba64-489d-9680-b4e5ac76b8b0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.724939 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e59b6fbb-ba64-489d-9680-b4e5ac76b8b0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:47.732695 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e59b6fbb-ba64-489d-9680-b4e5ac76b8b0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1679 microversion: 2.1 time: 0.157300 Jul 24 01:18:47.733254 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 367/751] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:47 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:48.751227 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-755d570c-6fb8-4cde-8080-9480b2f82c89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:48.751961 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-755d570c-6fb8-4cde-8080-9480b2f82c89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:48.758630 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-755d570c-6fb8-4cde-8080-9480b2f82c89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:48.759073 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-755d570c-6fb8-4cde-8080-9480b2f82c89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.759884 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-755d570c-6fb8-4cde-8080-9480b2f82c89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:48.760305 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-755d570c-6fb8-4cde-8080-9480b2f82c89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.963845 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-755d570c-6fb8-4cde-8080-9480b2f82c89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:48.972479 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-755d570c-6fb8-4cde-8080-9480b2f82c89 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 200 len: 1679 microversion: 2.1 time: 0.225726 Jul 24 01:18:48.973292 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 385/752] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:48 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:49.502069 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-1cca504e-726a-497c-b570-01312bc41bd6 req-846a91b8-c5ad-4c14-b34b-ae6a561dd7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0506b1-88fd-49f6-a2f5-88288c722940", "name": "network-vif-deleted", "tag": "1ab3d91c-9b3a-47af-b569-49fa8cc163f2"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:49.512154 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-1cca504e-726a-497c-b570-01312bc41bd6 req-846a91b8-c5ad-4c14-b34b-ae6a561dd7da service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.512723 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-1cca504e-726a-497c-b570-01312bc41bd6 req-846a91b8-c5ad-4c14-b34b-ae6a561dd7da service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:49.525223 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-1cca504e-726a-497c-b570-01312bc41bd6 req-846a91b8-c5ad-4c14-b34b-ae6a561dd7da service nova] Creating event network-vif-deleted:1ab3d91c-9b3a-47af-b569-49fa8cc163f2 for instance dc0506b1-88fd-49f6-a2f5-88288c722940 on hv-cinder-maste Jul 24 01:18:49.530538 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-1cca504e-726a-497c-b570-01312bc41bd6 req-846a91b8-c5ad-4c14-b34b-ae6a561dd7da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032182 Jul 24 01:18:49.531117 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 368/753] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:49.990225 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:49.990960 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:49.997510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.998037 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:49.998879 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.999397 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.014118 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 HTTP/1.1 Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:18:50.015809 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:18:50.017958 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': 'dc0506b1-88fd-49f6-a2f5-88288c722940'} Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:50.018896 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:18:50.020443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:18:50.022653 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:50.022653 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f58ab2f0-8ec4-4447-9a83-e75ff4209241 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 404 len: 111 microversion: 2.1 time: 0.031124 Jul 24 01:18:50.022653 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 386/754] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:49 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:50.027016 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d8048ba5-8aa2-4de4-be38-08a4522d792b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '.version_select at 0x7fdf3c0bdca0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:50.051506 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d8048ba5-8aa2-4de4-be38-08a4522d792b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-936792505" status: 202 len: 0 microversion: 2.1 time: 0.028699 Jul 24 01:18:50.052166 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 369/755] 10.222.0.42 () {58 vars in 1217 bytes} [Sun Jul 24 01:18:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-936792505 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:18:50.681926 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2d7c791d-62ba-47ce-b19b-15494e54cf0b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: .version_select at 0x7fdf3c1c7940>, body: {"keypair": {"name": "tempest-keypair-1733885627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHMHgbaeKxRcWSjp8trbYYDwdC7lSIjKruAnhxL/SrKEyuzLmaIZV5W9nmC7QmEeA8HFU/HtgNmWlGoJj7KkL0jpXquzWCY17uE/xBnzDyLIybfcRormnTAJIjg903qrA=="}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:50.700762 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-2d7c791d-62ba-47ce-b19b-15494e54cf0b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:50.704736 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-2d7c791d-62ba-47ce-b19b-15494e54cf0b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for user 1e7d0f401530454ba0cae0f5e9d6e0ce and project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:50.728781 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2d7c791d-62ba-47ce-b19b-15494e54cf0b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050675 Jul 24 01:18:50.729369 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 387/756] 10.222.0.42 () {60 vars in 1158 bytes} [Sun Jul 24 01:18:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:52.054401 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-976050868", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcbaf71d-4a65-44d0-a781-ad7ed5a13863"}], "security_groups": [{"name": "tempest-securitygroup--912564098"}], "key_name": "tempest-keypair-1733885627", "user_data": "}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:52.156989 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] validate_networks() for [('fcbaf71d-4a65-44d0-a781-ad7ed5a13863', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:18:52.790083 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:18:52.790783 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:18:52.791595 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:18:52.792237 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:18:52.792878 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:18:52.802956 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:52.803444 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:52.804234 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:52.804665 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:52.821537 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:52.825694 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Getting quotas for user 1e7d0f401530454ba0cae0f5e9d6e0ce and project b6578102e5a746a584bcc9e4b2f64d46. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:52.837132 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:18:52.839585 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:18:52.886579 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-82f9f36b-687c-4ff2-9d98-c8d2c51eee77 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.836984 Jul 24 01:18:52.887226 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 370/757] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:18:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:18:52.898612 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6e3ca0f1-af0b-44ed-840e-5494b355fbd6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:52.899239 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6e3ca0f1-af0b-44ed-840e-5494b355fbd6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:52.954093 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6e3ca0f1-af0b-44ed-840e-5494b355fbd6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:52.961835 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6e3ca0f1-af0b-44ed-840e-5494b355fbd6 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1241 microversion: 2.1 time: 0.067959 Jul 24 01:18:52.962382 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 388/758] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:52 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:53.979543 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6d63f74d-12a2-490a-b6d9-b60d1f9185e3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:53.980375 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6d63f74d-12a2-490a-b6d9-b60d1f9185e3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:53.987791 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6d63f74d-12a2-490a-b6d9-b60d1f9185e3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:53.988637 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6d63f74d-12a2-490a-b6d9-b60d1f9185e3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:53.989296 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6d63f74d-12a2-490a-b6d9-b60d1f9185e3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:53.990071 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6d63f74d-12a2-490a-b6d9-b60d1f9185e3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:54.058836 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6d63f74d-12a2-490a-b6d9-b60d1f9185e3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:54.066576 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6d63f74d-12a2-490a-b6d9-b60d1f9185e3 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1311 microversion: 2.1 time: 0.092168 Jul 24 01:18:54.067329 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 371/759] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:53 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:55.083882 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3b6d4f69-88cf-40cd-8366-efa6b632d1ba tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:55.084533 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3b6d4f69-88cf-40cd-8366-efa6b632d1ba tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:55.092130 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3b6d4f69-88cf-40cd-8366-efa6b632d1ba tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.092574 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3b6d4f69-88cf-40cd-8366-efa6b632d1ba tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.093340 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3b6d4f69-88cf-40cd-8366-efa6b632d1ba tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.093772 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3b6d4f69-88cf-40cd-8366-efa6b632d1ba tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.299242 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3b6d4f69-88cf-40cd-8366-efa6b632d1ba tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:55.306997 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3b6d4f69-88cf-40cd-8366-efa6b632d1ba tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1366 microversion: 2.1 time: 0.227057 Jul 24 01:18:55.307603 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 389/760] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:55 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:55.449897 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-0beebb15-321b-4244-9259-81d2cc227590 req-95dfef55-8e87-420c-94dd-46c23843870f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8162e788-e015-4213-b5bc-6cd1888bff6e", "tag": "c0feae08-d63b-41a8-83a5-c56ee79f699a"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:55.463322 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0beebb15-321b-4244-9259-81d2cc227590 req-95dfef55-8e87-420c-94dd-46c23843870f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.463807 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-0beebb15-321b-4244-9259-81d2cc227590 req-95dfef55-8e87-420c-94dd-46c23843870f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.476861 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-0beebb15-321b-4244-9259-81d2cc227590 req-95dfef55-8e87-420c-94dd-46c23843870f service nova] Creating event network-changed:c0feae08-d63b-41a8-83a5-c56ee79f699a for instance 8162e788-e015-4213-b5bc-6cd1888bff6e on hv-cinder-maste Jul 24 01:18:55.481941 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-0beebb15-321b-4244-9259-81d2cc227590 req-95dfef55-8e87-420c-94dd-46c23843870f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035642 Jul 24 01:18:55.482630 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 372/761] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:56.328551 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ca3540bd-38c7-469a-99b8-d7ddd9554866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:56.329464 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ca3540bd-38c7-469a-99b8-d7ddd9554866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:56.340872 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ca3540bd-38c7-469a-99b8-d7ddd9554866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:56.341585 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ca3540bd-38c7-469a-99b8-d7ddd9554866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.342384 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ca3540bd-38c7-469a-99b8-d7ddd9554866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:56.342824 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ca3540bd-38c7-469a-99b8-d7ddd9554866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.481244 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ca3540bd-38c7-469a-99b8-d7ddd9554866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:56.488996 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ca3540bd-38c7-469a-99b8-d7ddd9554866 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1366 microversion: 2.1 time: 0.167182 Jul 24 01:18:56.489553 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 390/762] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:56 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:57.511143 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c402dd56-38a5-46e5-b858-1b918b13b8f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:57.511864 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c402dd56-38a5-46e5-b858-1b918b13b8f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:57.519177 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c402dd56-38a5-46e5-b858-1b918b13b8f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:57.519643 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c402dd56-38a5-46e5-b858-1b918b13b8f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:57.520402 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c402dd56-38a5-46e5-b858-1b918b13b8f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:57.520831 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c402dd56-38a5-46e5-b858-1b918b13b8f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:57.538686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:57.656276 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c402dd56-38a5-46e5-b858-1b918b13b8f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:57.667824 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c402dd56-38a5-46e5-b858-1b918b13b8f0 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1366 microversion: 2.1 time: 0.163774 Jul 24 01:18:57.668605 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 373/763] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:57 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:58.690005 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-92342fc0-5c56-46b6-863f-5c5a01601a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:58.690604 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-92342fc0-5c56-46b6-863f-5c5a01601a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:58.697511 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-92342fc0-5c56-46b6-863f-5c5a01601a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:58.698114 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-92342fc0-5c56-46b6-863f-5c5a01601a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:58.698932 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-92342fc0-5c56-46b6-863f-5c5a01601a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:58.699572 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-92342fc0-5c56-46b6-863f-5c5a01601a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:58.917009 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-92342fc0-5c56-46b6-863f-5c5a01601a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:58.920673 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:58.926082 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-92342fc0-5c56-46b6-863f-5c5a01601a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1366 microversion: 2.1 time: 0.239913 Jul 24 01:18:58.926647 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 391/764] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:58 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:59.946298 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-31e42901-6eed-4f6d-86bb-6f5a988d0a06 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:59.947340 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-31e42901-6eed-4f6d-86bb-6f5a988d0a06 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:59.958427 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-31e42901-6eed-4f6d-86bb-6f5a988d0a06 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:59.959187 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-31e42901-6eed-4f6d-86bb-6f5a988d0a06 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:59.960515 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-31e42901-6eed-4f6d-86bb-6f5a988d0a06 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:59.961235 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-31e42901-6eed-4f6d-86bb-6f5a988d0a06 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:00.098437 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-31e42901-6eed-4f6d-86bb-6f5a988d0a06 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:00.110040 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-31e42901-6eed-4f6d-86bb-6f5a988d0a06 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1366 microversion: 2.1 time: 0.170180 Jul 24 01:19:00.110818 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 374/765] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:59 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:00.733792 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-775e01ee-3a2f-4008-a12f-0b81f0aa72e0 req-725abed5-e01d-4c5e-bdb4-296cd2767bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8162e788-e015-4213-b5bc-6cd1888bff6e", "name": "network-vif-plugged", "status": "completed", "tag": "c0feae08-d63b-41a8-83a5-c56ee79f699a"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:00.744082 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-775e01ee-3a2f-4008-a12f-0b81f0aa72e0 req-725abed5-e01d-4c5e-bdb4-296cd2767bb4 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:00.744535 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-775e01ee-3a2f-4008-a12f-0b81f0aa72e0 req-725abed5-e01d-4c5e-bdb4-296cd2767bb4 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:00.756762 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-775e01ee-3a2f-4008-a12f-0b81f0aa72e0 req-725abed5-e01d-4c5e-bdb4-296cd2767bb4 service nova] Creating event network-vif-plugged:c0feae08-d63b-41a8-83a5-c56ee79f699a for instance 8162e788-e015-4213-b5bc-6cd1888bff6e on hv-cinder-maste Jul 24 01:19:00.761635 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-775e01ee-3a2f-4008-a12f-0b81f0aa72e0 req-725abed5-e01d-4c5e-bdb4-296cd2767bb4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032081 Jul 24 01:19:00.762256 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 392/766] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:01.132002 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7bc441c4-9bc2-489a-9f38-d64fdebb5fe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:01.132550 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7bc441c4-9bc2-489a-9f38-d64fdebb5fe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:01.139826 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7bc441c4-9bc2-489a-9f38-d64fdebb5fe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:01.140295 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7bc441c4-9bc2-489a-9f38-d64fdebb5fe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:01.141020 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7bc441c4-9bc2-489a-9f38-d64fdebb5fe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:01.141450 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7bc441c4-9bc2-489a-9f38-d64fdebb5fe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:01.281399 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7bc441c4-9bc2-489a-9f38-d64fdebb5fe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:01.289460 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7bc441c4-9bc2-489a-9f38-d64fdebb5fe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1366 microversion: 2.1 time: 0.161803 Jul 24 01:19:01.290032 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 375/767] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:01 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:02.307883 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1e3993a9-99d7-49c5-919c-7b853e057d92 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:02.308453 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1e3993a9-99d7-49c5-919c-7b853e057d92 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:02.316410 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e3993a9-99d7-49c5-919c-7b853e057d92 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.316860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e3993a9-99d7-49c5-919c-7b853e057d92 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:02.317640 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e3993a9-99d7-49c5-919c-7b853e057d92 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.318074 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e3993a9-99d7-49c5-919c-7b853e057d92 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:02.453857 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1e3993a9-99d7-49c5-919c-7b853e057d92 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:02.462490 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1e3993a9-99d7-49c5-919c-7b853e057d92 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1366 microversion: 2.1 time: 0.159549 Jul 24 01:19:02.463069 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 393/768] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:02 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:03.483215 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-158be753-c81a-4722-85d4-2ca240f41655 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:03.484026 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-158be753-c81a-4722-85d4-2ca240f41655 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:03.486821 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:03.487655 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=6 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:03.495183 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-158be753-c81a-4722-85d4-2ca240f41655 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:03.495770 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-158be753-c81a-4722-85d4-2ca240f41655 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:03.496721 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-158be753-c81a-4722-85d4-2ca240f41655 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:03.497264 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-158be753-c81a-4722-85d4-2ca240f41655 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:03.629780 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-158be753-c81a-4722-85d4-2ca240f41655 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:03.637291 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-158be753-c81a-4722-85d4-2ca240f41655 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1557 microversion: 2.1 time: 0.160413 Jul 24 01:19:03.637835 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 376/769] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:03 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:03.654018 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-312547b6-d575-4ddc-b9ed-8d090e2ecbe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:03.654492 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-312547b6-d575-4ddc-b9ed-8d090e2ecbe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:03.656433 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=6 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:03.662426 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-312547b6-d575-4ddc-b9ed-8d090e2ecbe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:03.662873 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-312547b6-d575-4ddc-b9ed-8d090e2ecbe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:03.663657 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-312547b6-d575-4ddc-b9ed-8d090e2ecbe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:03.664086 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-312547b6-d575-4ddc-b9ed-8d090e2ecbe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:03.742872 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-312547b6-d575-4ddc-b9ed-8d090e2ecbe7 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092773 Jul 24 01:19:03.743487 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 394/770] 10.222.0.42 () {58 vars in 1274 bytes} [Sun Jul 24 01:19:03 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:04.651240 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-c0c5cc7a-c581-4f67-889e-c7ecf58a37e8 req-4849efd4-66af-49e4-9e8e-ba5afdb4bb75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8162e788-e015-4213-b5bc-6cd1888bff6e", "tag": "c0feae08-d63b-41a8-83a5-c56ee79f699a"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:04.660203 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-c0c5cc7a-c581-4f67-889e-c7ecf58a37e8 req-4849efd4-66af-49e4-9e8e-ba5afdb4bb75 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:04.660644 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-c0c5cc7a-c581-4f67-889e-c7ecf58a37e8 req-4849efd4-66af-49e4-9e8e-ba5afdb4bb75 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:04.672271 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-c0c5cc7a-c581-4f67-889e-c7ecf58a37e8 req-4849efd4-66af-49e4-9e8e-ba5afdb4bb75 service nova] Creating event network-changed:c0feae08-d63b-41a8-83a5-c56ee79f699a for instance 8162e788-e015-4213-b5bc-6cd1888bff6e on hv-cinder-maste Jul 24 01:19:04.678275 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-c0c5cc7a-c581-4f67-889e-c7ecf58a37e8 req-4849efd4-66af-49e4-9e8e-ba5afdb4bb75 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030680 Jul 24 01:19:04.679181 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 377/771] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:26.469209 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:26.470436 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=12 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:26.474696 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-34034a47-6598-4887-bd3a-6dd8c2c78771 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:26.475142 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-34034a47-6598-4887-bd3a-6dd8c2c78771 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:26.482690 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-34034a47-6598-4887-bd3a-6dd8c2c78771 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:26.483170 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-34034a47-6598-4887-bd3a-6dd8c2c78771 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:26.484134 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-34034a47-6598-4887-bd3a-6dd8c2c78771 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:26.484727 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-34034a47-6598-4887-bd3a-6dd8c2c78771 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:26.510300 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-34034a47-6598-4887-bd3a-6dd8c2c78771 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/ips" status: 200 len: 145 microversion: 2.1 time: 0.043446 Jul 24 01:19:26.510858 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 395/772] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:19:26 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:27.843928 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:27.845164 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=22 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:27.849453 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8dc2a3ee-f016-4e35-8923-77c74c67c707 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "289ff62d-119d-4aba-a67d-f14041192c41"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:27.850659 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8dc2a3ee-f016-4e35-8923-77c74c67c707 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:27.858038 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8dc2a3ee-f016-4e35-8923-77c74c67c707 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:27.858484 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8dc2a3ee-f016-4e35-8923-77c74c67c707 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:27.859272 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8dc2a3ee-f016-4e35-8923-77c74c67c707 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:27.859730 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8dc2a3ee-f016-4e35-8923-77c74c67c707 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:28.131252 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8dc2a3ee-f016-4e35-8923-77c74c67c707 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288835 Jul 24 01:19:28.132035 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 378/773] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:19:27 2022] POST /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:30.363765 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f9cf73b7-6f3b-44d5-ae81-6dc917880c8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:30.364700 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f9cf73b7-6f3b-44d5-ae81-6dc917880c8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:30.371540 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9cf73b7-6f3b-44d5-ae81-6dc917880c8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:30.371991 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9cf73b7-6f3b-44d5-ae81-6dc917880c8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:30.372755 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9cf73b7-6f3b-44d5-ae81-6dc917880c8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:30.373174 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f9cf73b7-6f3b-44d5-ae81-6dc917880c8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:30.408149 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f9cf73b7-6f3b-44d5-ae81-6dc917880c8f tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048363 Jul 24 01:19:30.408689 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 396/774] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:19:30 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:30.419184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9794493b-b155-47e9-bb5c-1cb7f78d34db tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:30.419813 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9794493b-b155-47e9-bb5c-1cb7f78d34db tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:30.427256 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9794493b-b155-47e9-bb5c-1cb7f78d34db tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:30.427727 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9794493b-b155-47e9-bb5c-1cb7f78d34db tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:30.428487 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9794493b-b155-47e9-bb5c-1cb7f78d34db tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:30.428923 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9794493b-b155-47e9-bb5c-1cb7f78d34db tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:30.457073 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9794493b-b155-47e9-bb5c-1cb7f78d34db tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/289ff62d-119d-4aba-a67d-f14041192c41" status: 200 len: 194 microversion: 2.1 time: 0.042176 Jul 24 01:19:30.457620 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 379/775] 10.222.0.42 () {58 vars in 1412 bytes} [Sun Jul 24 01:19:30 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/289ff62d-119d-4aba-a67d-f14041192c41 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:31.794071 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5a96bba5-3b36-4f7b-89c2-75e2c05770d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "601b7d3e-94f6-4723-97c8-650c7de981b4"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:31.795132 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-5a96bba5-3b36-4f7b-89c2-75e2c05770d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:31.802762 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a96bba5-3b36-4f7b-89c2-75e2c05770d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:31.803219 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a96bba5-3b36-4f7b-89c2-75e2c05770d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:31.804027 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a96bba5-3b36-4f7b-89c2-75e2c05770d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:31.804464 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-5a96bba5-3b36-4f7b-89c2-75e2c05770d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:32.069032 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5a96bba5-3b36-4f7b-89c2-75e2c05770d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "POST /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278665 Jul 24 01:19:32.069638 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 397/776] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:19:31 2022] POST /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:34.318694 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-32831af1-2548-475c-a13c-298831b44797 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:34.319658 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-32831af1-2548-475c-a13c-298831b44797 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:34.326551 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-32831af1-2548-475c-a13c-298831b44797 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.326994 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-32831af1-2548-475c-a13c-298831b44797 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.327793 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-32831af1-2548-475c-a13c-298831b44797 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.328227 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-32831af1-2548-475c-a13c-298831b44797 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.357327 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-32831af1-2548-475c-a13c-298831b44797 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042603 Jul 24 01:19:34.357870 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 380/777] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:19:34 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:34.509806 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-97d07025-faca-4b1c-91db-779ab2594e0a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:34.510471 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-97d07025-faca-4b1c-91db-779ab2594e0a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:34.518457 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-97d07025-faca-4b1c-91db-779ab2594e0a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.518987 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-97d07025-faca-4b1c-91db-779ab2594e0a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.519934 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-97d07025-faca-4b1c-91db-779ab2594e0a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.520453 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-97d07025-faca-4b1c-91db-779ab2594e0a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.551863 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-97d07025-faca-4b1c-91db-779ab2594e0a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/289ff62d-119d-4aba-a67d-f14041192c41" status: 200 len: 194 microversion: 2.1 time: 0.047945 Jul 24 01:19:34.552449 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 398/778] 10.222.0.42 () {58 vars in 1412 bytes} [Sun Jul 24 01:19:34 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/289ff62d-119d-4aba-a67d-f14041192c41 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:34.562473 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a6df764b-6af6-4f13-a4d2-05f88f1516d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:34.562967 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a6df764b-6af6-4f13-a4d2-05f88f1516d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:34.569470 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a6df764b-6af6-4f13-a4d2-05f88f1516d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.569919 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a6df764b-6af6-4f13-a4d2-05f88f1516d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.570677 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a6df764b-6af6-4f13-a4d2-05f88f1516d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.571109 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a6df764b-6af6-4f13-a4d2-05f88f1516d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.652048 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-a6df764b-6af6-4f13-a4d2-05f88f1516d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lazy-loading 'services' on Instance uuid bec98a72-8d97-4a98-80b3-f5d0a6adce26 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:19:34.727223 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a6df764b-6af6-4f13-a4d2-05f88f1516d3 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/289ff62d-119d-4aba-a67d-f14041192c41" status: 202 len: 0 microversion: 2.1 time: 0.168583 Jul 24 01:19:34.727843 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 381/779] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:19:34 2022] DELETE /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/289ff62d-119d-4aba-a67d-f14041192c41 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:19:36.916186 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d786a417-4a15-40f7-ac2b-e3378db8a9a7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:36.916714 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d786a417-4a15-40f7-ac2b-e3378db8a9a7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:36.923943 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d786a417-4a15-40f7-ac2b-e3378db8a9a7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.924389 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d786a417-4a15-40f7-ac2b-e3378db8a9a7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:36.925148 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d786a417-4a15-40f7-ac2b-e3378db8a9a7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.925577 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d786a417-4a15-40f7-ac2b-e3378db8a9a7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:36.953886 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d786a417-4a15-40f7-ac2b-e3378db8a9a7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/601b7d3e-94f6-4723-97c8-650c7de981b4" status: 200 len: 194 microversion: 2.1 time: 0.041877 Jul 24 01:19:36.954448 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 399/780] 10.222.0.42 () {58 vars in 1412 bytes} [Sun Jul 24 01:19:36 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/601b7d3e-94f6-4723-97c8-650c7de981b4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:36.965298 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-48072a72-9973-4784-85b2-c13cacac9012 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:36.965894 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-48072a72-9973-4784-85b2-c13cacac9012 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:36.972565 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-48072a72-9973-4784-85b2-c13cacac9012 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.973053 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-48072a72-9973-4784-85b2-c13cacac9012 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:36.973775 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-48072a72-9973-4784-85b2-c13cacac9012 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.974199 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-48072a72-9973-4784-85b2-c13cacac9012 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.064303 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-48072a72-9973-4784-85b2-c13cacac9012 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lazy-loading 'services' on Instance uuid bec98a72-8d97-4a98-80b3-f5d0a6adce26 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:19:37.145866 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-48072a72-9973-4784-85b2-c13cacac9012 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/601b7d3e-94f6-4723-97c8-650c7de981b4" status: 202 len: 0 microversion: 2.1 time: 0.185194 Jul 24 01:19:37.146473 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 382/781] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:19:36 2022] DELETE /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments/601b7d3e-94f6-4723-97c8-650c7de981b4 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:19:38.315705 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-be2c3af5-d2cb-4a67-bcd8-2096a3e1665a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:38.316700 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-be2c3af5-d2cb-4a67-bcd8-2096a3e1665a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:38.323642 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be2c3af5-d2cb-4a67-bcd8-2096a3e1665a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.324088 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be2c3af5-d2cb-4a67-bcd8-2096a3e1665a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.324840 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be2c3af5-d2cb-4a67-bcd8-2096a3e1665a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.325273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be2c3af5-d2cb-4a67-bcd8-2096a3e1665a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.354427 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-be2c3af5-d2cb-4a67-bcd8-2096a3e1665a tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042762 Jul 24 01:19:38.354955 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 400/782] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:19:38 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:19:38.462016 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7156aa4c-f908-4373-bba6-9316a9240f1b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:38.463067 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7156aa4c-f908-4373-bba6-9316a9240f1b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:38.469584 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7156aa4c-f908-4373-bba6-9316a9240f1b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.470022 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7156aa4c-f908-4373-bba6-9316a9240f1b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.470765 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7156aa4c-f908-4373-bba6-9316a9240f1b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.471188 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7156aa4c-f908-4373-bba6-9316a9240f1b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.500201 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7156aa4c-f908-4373-bba6-9316a9240f1b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043056 Jul 24 01:19:38.500733 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 383/783] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:19:38 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:19:38.562469 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-66e458fc-7603-4f12-9ad2-bd6c12599499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:38.562905 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-66e458fc-7603-4f12-9ad2-bd6c12599499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:38.569282 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-66e458fc-7603-4f12-9ad2-bd6c12599499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.569736 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-66e458fc-7603-4f12-9ad2-bd6c12599499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.570508 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-66e458fc-7603-4f12-9ad2-bd6c12599499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.570945 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-66e458fc-7603-4f12-9ad2-bd6c12599499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.595329 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-66e458fc-7603-4f12-9ad2-bd6c12599499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:19:38.675710 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-66e458fc-7603-4f12-9ad2-bd6c12599499 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 204 len: 0 microversion: 2.1 time: 0.116807 Jul 24 01:19:38.676497 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 401/784] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:19:38 2022] DELETE /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:19:38.685183 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0b285aae-801f-4b4f-8952-6429e91ad215 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:38.685793 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0b285aae-801f-4b4f-8952-6429e91ad215 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:38.692053 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b285aae-801f-4b4f-8952-6429e91ad215 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.692498 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b285aae-801f-4b4f-8952-6429e91ad215 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.693244 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b285aae-801f-4b4f-8952-6429e91ad215 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.693705 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0b285aae-801f-4b4f-8952-6429e91ad215 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.824593 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-0b285aae-801f-4b4f-8952-6429e91ad215 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:38.832403 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0b285aae-801f-4b4f-8952-6429e91ad215 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1672 microversion: 2.1 time: 0.151103 Jul 24 01:19:38.832969 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 384/785] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:38 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:39.850667 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0c59453a-4d4e-4d52-a982-9171a52dab6e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:39.851393 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0c59453a-4d4e-4d52-a982-9171a52dab6e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:39.858343 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0c59453a-4d4e-4d52-a982-9171a52dab6e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:39.858786 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0c59453a-4d4e-4d52-a982-9171a52dab6e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:39.859589 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0c59453a-4d4e-4d52-a982-9171a52dab6e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:39.860020 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0c59453a-4d4e-4d52-a982-9171a52dab6e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:39.996894 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0c59453a-4d4e-4d52-a982-9171a52dab6e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:40.008915 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0c59453a-4d4e-4d52-a982-9171a52dab6e tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1672 microversion: 2.1 time: 0.162197 Jul 24 01:19:40.009627 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 402/786] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:39 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:41.028968 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5de482c5-b9ff-440e-97ed-d60eab7ab5a5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:41.029535 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5de482c5-b9ff-440e-97ed-d60eab7ab5a5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:41.036518 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5de482c5-b9ff-440e-97ed-d60eab7ab5a5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.036964 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5de482c5-b9ff-440e-97ed-d60eab7ab5a5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.037714 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5de482c5-b9ff-440e-97ed-d60eab7ab5a5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.038161 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5de482c5-b9ff-440e-97ed-d60eab7ab5a5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.274085 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5de482c5-b9ff-440e-97ed-d60eab7ab5a5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:41.281908 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5de482c5-b9ff-440e-97ed-d60eab7ab5a5 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1672 microversion: 2.1 time: 0.256808 Jul 24 01:19:41.282475 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 385/787] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:41 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1672 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:41.916932 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-66ee486a-dcae-468f-8235-be75e404ed9e req-67c6aba5-2111-470d-b0fd-668832bc4b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bec98a72-8d97-4a98-80b3-f5d0a6adce26", "name": "network-vif-deleted", "tag": "bd7d30c1-3271-400d-a012-93da64c9b5f7"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:41.925972 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-66ee486a-dcae-468f-8235-be75e404ed9e req-67c6aba5-2111-470d-b0fd-668832bc4b81 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.926418 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-66ee486a-dcae-468f-8235-be75e404ed9e req-67c6aba5-2111-470d-b0fd-668832bc4b81 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.941891 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-66ee486a-dcae-468f-8235-be75e404ed9e req-67c6aba5-2111-470d-b0fd-668832bc4b81 service nova] Creating event network-vif-deleted:bd7d30c1-3271-400d-a012-93da64c9b5f7 for instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 on hv-cinder-maste Jul 24 01:19:41.948385 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-66ee486a-dcae-468f-8235-be75e404ed9e req-67c6aba5-2111-470d-b0fd-668832bc4b81 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035077 Jul 24 01:19:41.949385 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 403/788] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:42.299948 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:42.300708 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:42.307493 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:42.307930 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:42.308693 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:42.309130 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:42.339600 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:42.340047 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:42.340490 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lazy-loading 'fault' on Instance uuid bec98a72-8d97-4a98-80b3-f5d0a6adce26 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:19:42.383246 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601f4db65bf74587ab9b0080a44b4f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1d39abfaef4e9c80564f545f431bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:42.393283 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9c353d85-efc8-44e2-b6ac-c99fe841998b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 200 len: 1327 microversion: 2.1 time: 0.096908 Jul 24 01:19:42.393907 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 386/789] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:42 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:43.416476 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:43.417633 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:43.428780 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:43.429531 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:43.430934 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:43.431723 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:43.448276 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] HTTP exception thrown: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Request method failure captured: Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 HTTP/1.1 Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3Jxb_CJGvwGq8heUUEy3PjUz4phhRL8nkX0-X_9606kxTANwH4xr9LIMjUfjoAE3x9SO89WGveJXsqABpLTPHFKHDtskGFRoy_kwhaa157u4CjlrHAXDP5jAL-bTVsTQ1X0PM8V7KGSIcC_ReiIEIRd9ZO_eZaZpasbZkySFNlM5WZM Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:19:43.449932 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cc1d39abfaef4e9c80564f545f431bbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}] Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 601f4db65bf74587ab9b0080a44b4f79 Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:43.451596 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': 'bec98a72-8d97-4a98-80b3-f5d0a6adce26'} Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:43.452513 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:43.453811 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:43.454966 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Returning 404 to user: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:43.454966 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-dbd4e439-6308-4cd7-9098-1961ca5815d2 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 404 len: 111 microversion: 2.1 time: 0.043179 Jul 24 01:19:43.454966 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 404/790] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:43 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:19:43.460535 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f94ebfe2-9aa9-46ea-9a9b-d5fcf7b8275d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '.version_select at 0x7fdf3c0c5430>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:43.479946 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f94ebfe2-9aa9-46ea-9a9b-d5fcf7b8275d tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435286646" status: 202 len: 0 microversion: 2.1 time: 0.023300 Jul 24 01:19:43.480652 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 387/791] 10.222.0.42 () {58 vars in 1220 bytes} [Sun Jul 24 01:19:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435286646 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:19:46.447900 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:46.448377 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:46.455063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.455558 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.456320 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.456760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.470288 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] HTTP exception thrown: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Request method failure captured: Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: DELETE /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 HTTP/1.1 Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3Jxb_CJGvwGq8heUUEy3PjUz4phhRL8nkX0-X_9606kxTANwH4xr9LIMjUfjoAE3x9SO89WGveJXsqABpLTPHFKHDtskGFRoy_kwhaa157u4CjlrHAXDP5jAL-bTVsTQ1X0PM8V7KGSIcC_ReiIEIRd9ZO_eZaZpasbZkySFNlM5WZM Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:19:46.471933 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cc1d39abfaef4e9c80564f545f431bbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}] Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 601f4db65bf74587ab9b0080a44b4f79 Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.473723 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': 'bec98a72-8d97-4a98-80b3-f5d0a6adce26'} Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:46.474729 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.476377 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.478040 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Returning 404 to user: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:46.478040 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d5d6d6e5-4771-42a5-a58c-67177d12623b tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 404 len: 111 microversion: 2.1 time: 0.029307 Jul 24 01:19:46.478040 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 405/792] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:19:46 2022] DELETE /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:19:46.489937 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:46.490537 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: bec98a72-8d97-4a98-80b3-f5d0a6adce26] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:46.497002 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.497450 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.498231 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.498663 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.512334 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] HTTP exception thrown: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Request method failure captured: Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 HTTP/1.1 Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3Jxb_CJGvwGq8heUUEy3PjUz4phhRL8nkX0-X_9606kxTANwH4xr9LIMjUfjoAE3x9SO89WGveJXsqABpLTPHFKHDtskGFRoy_kwhaa157u4CjlrHAXDP5jAL-bTVsTQ1X0PM8V7KGSIcC_ReiIEIRd9ZO_eZaZpasbZkySFNlM5WZM Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:19:46.514228 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cc1d39abfaef4e9c80564f545f431bbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}] Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 601f4db65bf74587ab9b0080a44b4f79 Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.515916 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'bec98a72-8d97-4a98-80b3-f5d0a6adce26'} Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:46.516764 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. Jul 24 01:19:46.518074 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:46.519244 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Returning 404 to user: Instance bec98a72-8d97-4a98-80b3-f5d0a6adce26 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:46.519244 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-80a48c2f-8c79-4650-8cd6-26e6b10241f7 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26" status: 404 len: 111 microversion: 2.1 time: 0.030622 Jul 24 01:19:46.519244 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 388/793] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:46 2022] GET /compute/v2.1/servers/bec98a72-8d97-4a98-80b3-f5d0a6adce26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:19:47.664598 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:47.665121 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:47.672929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.673529 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.675033 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.675761 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.696751 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] HTTP exception thrown: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Request method failure captured: Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: DELETE /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba HTTP/1.1 Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3Jxb_CJGvwGq8heUUEy3PjUz4phhRL8nkX0-X_9606kxTANwH4xr9LIMjUfjoAE3x9SO89WGveJXsqABpLTPHFKHDtskGFRoy_kwhaa157u4CjlrHAXDP5jAL-bTVsTQ1X0PM8V7KGSIcC_ReiIEIRd9ZO_eZaZpasbZkySFNlM5WZM Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:19:47.699271 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cc1d39abfaef4e9c80564f545f431bbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}] Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 601f4db65bf74587ab9b0080a44b4f79 Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.701400 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '76c12186-86f3-4887-9e0a-ed1b48f307ba'} Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:47.702779 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.705128 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.706527 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Returning 404 to user: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:47.706527 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-246a3a36-3b76-497d-a614-257acf0bb922 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "DELETE /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 404 len: 111 microversion: 2.1 time: 0.040976 Jul 24 01:19:47.706527 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 406/794] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:19:47 2022] DELETE /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:19:47.711599 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:47.712212 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] [instance: 76c12186-86f3-4887-9e0a-ed1b48f307ba] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:47.719101 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.719673 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.720349 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.720786 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.734023 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] HTTP exception thrown: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Request method failure captured: Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba HTTP/1.1 Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3Jxb_CJGvwGq8heUUEy3PjUz4phhRL8nkX0-X_9606kxTANwH4xr9LIMjUfjoAE3x9SO89WGveJXsqABpLTPHFKHDtskGFRoy_kwhaa157u4CjlrHAXDP5jAL-bTVsTQ1X0PM8V7KGSIcC_ReiIEIRd9ZO_eZaZpasbZkySFNlM5WZM Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:19:47.735551 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cc1d39abfaef4e9c80564f545f431bbe", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1d39abfaef4e9c80564f545f431bbe"}]}] Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: cc1d39abfaef4e9c80564f545f431bbe Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1340412961 Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 601f4db65bf74587ab9b0080a44b4f79 Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeTestJSON-1340412961-project Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.737077 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '76c12186-86f3-4887-9e0a-ed1b48f307ba'} Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:47.737933 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. Jul 24 01:19:47.739370 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:19:47.740646 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] Returning 404 to user: Instance 76c12186-86f3-4887-9e0a-ed1b48f307ba could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:47.740646 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5eaee9d0-e862-4659-82ce-77dc0a608590 tempest-AttachVolumeTestJSON-1340412961 tempest-AttachVolumeTestJSON-1340412961-project] 10.222.0.42 "GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba" status: 404 len: 111 microversion: 2.1 time: 0.029281 Jul 24 01:19:47.740646 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 389/795] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:47 2022] GET /compute/v2.1/servers/76c12186-86f3-4887-9e0a-ed1b48f307ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:13.945055 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d13bc2a6-eff5-4082-ae2f-ab5477aeb2bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:13.945852 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d13bc2a6-eff5-4082-ae2f-ab5477aeb2bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:13.949976 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:13.951023 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:13.961285 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d13bc2a6-eff5-4082-ae2f-ab5477aeb2bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:13.961739 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d13bc2a6-eff5-4082-ae2f-ab5477aeb2bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:13.962497 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d13bc2a6-eff5-4082-ae2f-ab5477aeb2bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:13.962930 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d13bc2a6-eff5-4082-ae2f-ab5477aeb2bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:13.987685 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d13bc2a6-eff5-4082-ae2f-ab5477aeb2bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/ips" status: 200 len: 150 microversion: 2.20 time: 0.049265 Jul 24 01:20:13.988257 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 407/796] 10.222.0.42 () {60 vars in 1288 bytes} [Sun Jul 24 01:20:13 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:20:15.824033 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-aaeb08be-418a-420c-ba8e-3f9201a27d6a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:15.824550 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-aaeb08be-418a-420c-ba8e-3f9201a27d6a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:15.828639 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:15.829601 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:15.833930 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-aaeb08be-418a-420c-ba8e-3f9201a27d6a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:15.834575 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-aaeb08be-418a-420c-ba8e-3f9201a27d6a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:15.835538 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-aaeb08be-418a-420c-ba8e-3f9201a27d6a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:15.836328 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-aaeb08be-418a-420c-ba8e-3f9201a27d6a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:15.862953 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-aaeb08be-418a-420c-ba8e-3f9201a27d6a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lazy-loading 'flavor' on Instance uuid 77065eb8-1786-49a7-b12a-f672a4ff9d6c {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:16.118306 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-aaeb08be-418a-420c-ba8e-3f9201a27d6a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/action" status: 202 len: 0 microversion: 2.20 time: 0.297894 Jul 24 01:20:16.119063 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 390/797] 10.222.0.42 () {62 vars in 1318 bytes} [Sun Jul 24 01:20:15 2022] POST /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:16.127680 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:16.128242 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:16.135095 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:16.135584 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.136331 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:16.136763 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.267683 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.280775 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.283268 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.285115 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c2800912-4149-468f-b9bd-4eb2ecc9e505 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.161150 Jul 24 01:20:16.285962 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 408/798] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:16 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:20:17.309527 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:17.310340 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:17.317443 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:17.317825 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:17.318747 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:17.318995 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:17.455070 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:17.463444 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:17.465050 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:17.466206 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3fca7a04-c45c-40bb-ae89-96f1283b11fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.163496 Jul 24 01:20:17.466764 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 391/799] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:17 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:18.484423 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:18.485067 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:18.492018 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:18.492466 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:18.493231 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:18.493759 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:18.623617 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:18.631914 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:18.633494 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:18.634636 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c0f2fc12-28b2-4245-9867-29b5487ec452 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.154332 Jul 24 01:20:18.635201 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 409/800] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:18 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:19.656932 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:19.657804 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:19.668860 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:19.669593 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:19.670834 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:19.671984 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:19.808212 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.821999 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.823521 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.824696 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-dbbcdabb-4f42-4aa9-931b-cb26bf22807b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.174531 Jul 24 01:20:19.825229 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 392/801] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:19 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:20.710179 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6c0c062a-8d16-45dd-b497-049f10bb1a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:20.710893 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6c0c062a-8d16-45dd-b497-049f10bb1a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:20.718709 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6c0c062a-8d16-45dd-b497-049f10bb1a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.719433 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6c0c062a-8d16-45dd-b497-049f10bb1a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.720590 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6c0c062a-8d16-45dd-b497-049f10bb1a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.721246 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6c0c062a-8d16-45dd-b497-049f10bb1a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.751539 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6c0c062a-8d16-45dd-b497-049f10bb1a75 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/ips" status: 200 len: 151 microversion: 2.1 time: 0.047173 Jul 24 01:20:20.752088 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 410/802] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:20:20 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:20.843144 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:20.843792 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:20.850350 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.850794 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.851581 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.852011 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.990150 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:20.998262 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:20.999894 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:21.001188 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-976586ec-eebf-4b3e-9545-1f401e66a4d6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.161981 Jul 24 01:20:21.007642 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 393/803] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:20 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:22.021965 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:22.022580 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:22.029542 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.030057 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.030847 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.031381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.090163 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1818bf88-c845-46ed-ba06-02113bcaf8ea tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6777c158-3fb1-4134-9394-c1b4487cebf6"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:22.091282 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1818bf88-c845-46ed-ba06-02113bcaf8ea tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:22.098059 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1818bf88-c845-46ed-ba06-02113bcaf8ea tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.098506 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1818bf88-c845-46ed-ba06-02113bcaf8ea tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.099314 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1818bf88-c845-46ed-ba06-02113bcaf8ea tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.099749 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1818bf88-c845-46ed-ba06-02113bcaf8ea tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.165804 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:22.174339 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:22.175869 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:22.177118 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f2a50731-4c68-431b-8d3a-9842375041b6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.159138 Jul 24 01:20:22.177652 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 411/804] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:22 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:22.366347 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1818bf88-c845-46ed-ba06-02113bcaf8ea tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "POST /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280017 Jul 24 01:20:22.367223 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 394/805] 10.222.0.42 () {60 vars in 1322 bytes} [Sun Jul 24 01:20:22 2022] POST /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:23.196433 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:23.197061 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:23.203864 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:23.204307 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:23.205062 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:23.205482 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:23.334351 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.342413 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.343951 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.345108 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f8950772-d34d-49ed-9375-bac1c454f070 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.152714 Jul 24 01:20:23.345668 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 412/806] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:23 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:24.368387 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:24.369186 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:24.378001 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.378597 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.379681 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.380313 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.512980 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:24.520995 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:24.522439 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:24.523625 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d7736061-7f7a-4903-93c8-2e90c181c5a6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.162553 Jul 24 01:20:24.524500 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 395/807] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:24 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:24.696473 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2f1e1916-5c50-48eb-b577-d6b7826c1c73 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:24.697003 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-2f1e1916-5c50-48eb-b577-d6b7826c1c73 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:24.703774 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2f1e1916-5c50-48eb-b577-d6b7826c1c73 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.704219 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2f1e1916-5c50-48eb-b577-d6b7826c1c73 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.704978 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2f1e1916-5c50-48eb-b577-d6b7826c1c73 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.705419 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2f1e1916-5c50-48eb-b577-d6b7826c1c73 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.793816 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-2f1e1916-5c50-48eb-b577-d6b7826c1c73 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lazy-loading 'services' on Instance uuid 8162e788-e015-4213-b5bc-6cd1888bff6e {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:24.870819 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2f1e1916-5c50-48eb-b577-d6b7826c1c73 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-volume_attachments/6777c158-3fb1-4134-9394-c1b4487cebf6" status: 202 len: 0 microversion: 2.1 time: 0.178222 Jul 24 01:20:24.871569 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 413/808] 10.222.0.42 () {58 vars in 1415 bytes} [Sun Jul 24 01:20:24 2022] DELETE /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-volume_attachments/6777c158-3fb1-4134-9394-c1b4487cebf6 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:20:24.880249 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-448ddad8-048c-4aac-8a5d-0dc2e59c452c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:24.881199 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-448ddad8-048c-4aac-8a5d-0dc2e59c452c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:24.888464 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-448ddad8-048c-4aac-8a5d-0dc2e59c452c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.888984 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-448ddad8-048c-4aac-8a5d-0dc2e59c452c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.890043 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-448ddad8-048c-4aac-8a5d-0dc2e59c452c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.890479 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-448ddad8-048c-4aac-8a5d-0dc2e59c452c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.919781 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-448ddad8-048c-4aac-8a5d-0dc2e59c452c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Jul 24 01:20:24.920341 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 396/809] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:20:24 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:25.542856 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:25.543589 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:25.550267 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.550760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.551584 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.552033 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.688378 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.696470 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.697965 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.699231 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-96e27858-ff0d-4c63-9d12-1fc071130294 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.160774 Jul 24 01:20:25.699819 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 414/810] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:25 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:25.936474 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1636b8fe-3059-4d41-b945-b2497a8a650c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:25.938064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1636b8fe-3059-4d41-b945-b2497a8a650c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:25.949416 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1636b8fe-3059-4d41-b945-b2497a8a650c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.950164 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1636b8fe-3059-4d41-b945-b2497a8a650c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.951465 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1636b8fe-3059-4d41-b945-b2497a8a650c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.952195 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1636b8fe-3059-4d41-b945-b2497a8a650c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.985034 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1636b8fe-3059-4d41-b945-b2497a8a650c tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055277 Jul 24 01:20:25.985859 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 397/811] 10.222.0.42 () {58 vars in 1301 bytes} [Sun Jul 24 01:20:25 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:20:26.049642 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3b392a59-77d1-4a80-8d0f-1d88bc3f6224 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:26.050145 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3b392a59-77d1-4a80-8d0f-1d88bc3f6224 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:26.056848 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3b392a59-77d1-4a80-8d0f-1d88bc3f6224 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.057513 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3b392a59-77d1-4a80-8d0f-1d88bc3f6224 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.058294 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3b392a59-77d1-4a80-8d0f-1d88bc3f6224 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.058709 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3b392a59-77d1-4a80-8d0f-1d88bc3f6224 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.083694 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3b392a59-77d1-4a80-8d0f-1d88bc3f6224 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:26.159683 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3b392a59-77d1-4a80-8d0f-1d88bc3f6224 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 204 len: 0 microversion: 2.1 time: 0.113986 Jul 24 01:20:26.160258 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 415/812] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:26 2022] DELETE /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:26.168798 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-67f62b3e-ce06-49c7-8136-6f2257f59284 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:26.169415 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-67f62b3e-ce06-49c7-8136-6f2257f59284 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:26.175991 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67f62b3e-ce06-49c7-8136-6f2257f59284 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.176441 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67f62b3e-ce06-49c7-8136-6f2257f59284 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.177197 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67f62b3e-ce06-49c7-8136-6f2257f59284 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.177632 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-67f62b3e-ce06-49c7-8136-6f2257f59284 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.322030 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-67f62b3e-ce06-49c7-8136-6f2257f59284 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:26.329595 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-67f62b3e-ce06-49c7-8136-6f2257f59284 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1682 microversion: 2.1 time: 0.164706 Jul 24 01:20:26.330158 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 398/813] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:26 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:26.718087 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:26.718765 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:26.725221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.725669 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.726421 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.726847 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.863204 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:26.871338 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:26.872831 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:26.874201 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a1156914-0072-4cbb-9112-290f38723b4d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.160403 Jul 24 01:20:26.884040 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 416/814] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:26 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:27.346079 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6c565909-45a8-4bbc-be35-cf6d8a314f7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:27.346687 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6c565909-45a8-4bbc-be35-cf6d8a314f7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:27.353507 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6c565909-45a8-4bbc-be35-cf6d8a314f7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.353948 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6c565909-45a8-4bbc-be35-cf6d8a314f7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.354705 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6c565909-45a8-4bbc-be35-cf6d8a314f7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.355129 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6c565909-45a8-4bbc-be35-cf6d8a314f7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.499569 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6c565909-45a8-4bbc-be35-cf6d8a314f7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:27.507283 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6c565909-45a8-4bbc-be35-cf6d8a314f7f tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1682 microversion: 2.1 time: 0.165056 Jul 24 01:20:27.507870 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 399/815] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:27 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:27.893691 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:27.894279 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:27.901123 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.901811 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.902578 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.903205 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.050264 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:28.059082 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:28.060608 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:28.061752 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-aba9dd91-d95e-4782-aa02-905a05d0e3c4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.172115 Jul 24 01:20:28.062311 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 417/816] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:27 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:28.524745 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d648fc4b-ab20-4f81-9a60-778a2f065c27 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:28.525843 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d648fc4b-ab20-4f81-9a60-778a2f065c27 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:28.533214 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d648fc4b-ab20-4f81-9a60-778a2f065c27 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.533682 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d648fc4b-ab20-4f81-9a60-778a2f065c27 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.536053 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d648fc4b-ab20-4f81-9a60-778a2f065c27 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.536931 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d648fc4b-ab20-4f81-9a60-778a2f065c27 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.740886 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d648fc4b-ab20-4f81-9a60-778a2f065c27 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7d0f401530454ba0cae0f5e9d6e0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578102e5a746a584bcc9e4b2f64d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:28.751456 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d648fc4b-ab20-4f81-9a60-778a2f065c27 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 200 len: 1682 microversion: 2.1 time: 0.230480 Jul 24 01:20:28.752302 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 400/817] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:28 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:29.085378 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.086770 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:29.087270 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-24f41235-7b1b-479b-bc38-d80670c17717 req-77454dae-5c4b-4e17-9357-6c301e468854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8162e788-e015-4213-b5bc-6cd1888bff6e", "name": "network-vif-deleted", "tag": "c0feae08-d63b-41a8-83a5-c56ee79f699a"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:29.094506 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.095931 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.096924 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.097360 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.108218 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-24f41235-7b1b-479b-bc38-d80670c17717 req-77454dae-5c4b-4e17-9357-6c301e468854 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.109476 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-24f41235-7b1b-479b-bc38-d80670c17717 req-77454dae-5c4b-4e17-9357-6c301e468854 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.125207 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-24f41235-7b1b-479b-bc38-d80670c17717 req-77454dae-5c4b-4e17-9357-6c301e468854 service nova] Creating event network-vif-deleted:c0feae08-d63b-41a8-83a5-c56ee79f699a for instance 8162e788-e015-4213-b5bc-6cd1888bff6e on hv-cinder-maste Jul 24 01:20:29.130620 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-24f41235-7b1b-479b-bc38-d80670c17717 req-77454dae-5c4b-4e17-9357-6c301e468854 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054647 Jul 24 01:20:29.132141 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 418/818] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:29.251642 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:29.255742 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:29.257401 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:29.258588 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e606a9ef-2993-4109-835e-ba524274a8b3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1742 microversion: 2.20 time: 0.177431 Jul 24 01:20:29.270055 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 401/819] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:29 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:29.769326 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.770029 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:29.776616 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.777004 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.777783 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.778221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.792877 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e HTTP/1.1 Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:29.794808 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:29.796934 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '8162e788-e015-4213-b5bc-6cd1888bff6e'} Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:29.798142 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:29.800430 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.803319 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:29.804220 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9bc929ec-bca3-4405-8594-427d449a4bef tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 404 len: 111 microversion: 2.1 time: 0.039088 Jul 24 01:20:29.804785 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 419/820] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:29 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:29.815164 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f5ea06d2-0130-4b38-9279-757b2dda6229 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '.version_select at 0x7fdf3c0bdee0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.835790 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f5ea06d2-0130-4b38-9279-757b2dda6229 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733885627" status: 202 len: 0 microversion: 2.1 time: 0.026353 Jul 24 01:20:29.836487 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 402/821] 10.222.0.42 () {58 vars in 1220 bytes} [Sun Jul 24 01:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733885627 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:20:30.277579 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:30.278907 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:30.286709 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:30.287368 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:30.288225 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:30.288856 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:30.421784 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:30.430110 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:30.431709 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:30.432973 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4c4daccf-21ae-4024-9d0d-abf5fec83920 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1742 microversion: 2.20 time: 0.159532 Jul 24 01:20:30.433531 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 420/822] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:30 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:31.452116 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:31.452689 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:31.459908 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.460385 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.461242 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.461669 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.592892 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:31.596837 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:31.597350 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:31.601546 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:31.603044 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:31.604012 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.604188 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3bdfb8c8-7277-41b2-b522-22adcdb1e9d7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1742 microversion: 2.20 time: 0.156880 Jul 24 01:20:31.604464 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.604997 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 403/823] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:31 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:31.605223 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.605653 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.619606 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: DELETE /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e HTTP/1.1 Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:31.621142 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.622645 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '8162e788-e015-4213-b5bc-6cd1888bff6e'} Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:31.623587 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.625026 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.626455 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:31.626455 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3116d019-42a4-4960-9701-8c16c6227b90 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 404 len: 111 microversion: 2.1 time: 0.029567 Jul 24 01:20:31.626455 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 421/824] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:31 2022] DELETE /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:20:31.631065 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:31.631713 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: 8162e788-e015-4213-b5bc-6cd1888bff6e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:31.637902 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.638349 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.639112 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.639568 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.643709 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:31.654225 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e HTTP/1.1 Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:20:31.656032 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.657573 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '8162e788-e015-4213-b5bc-6cd1888bff6e'} Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:31.658405 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. Jul 24 01:20:31.659845 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:31.661157 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance 8162e788-e015-4213-b5bc-6cd1888bff6e could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:31.661157 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-676b8c59-ce72-439f-acc6-d5aa475a7381 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e" status: 404 len: 111 microversion: 2.1 time: 0.030092 Jul 24 01:20:31.661157 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 404/825] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:31 2022] GET /compute/v2.1/servers/8162e788-e015-4213-b5bc-6cd1888bff6e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:20:32.626957 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:32.627894 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:32.639004 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.639810 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.641065 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.641778 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.775515 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:32.783641 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:32.785109 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:32.786294 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9b08027d-c31c-408c-9ae5-c281810ddeed tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1742 microversion: 2.20 time: 0.166168 Jul 24 01:20:32.786857 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 422/826] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:32 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:32.800624 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:32.801176 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:32.807665 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.808101 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.808854 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.809277 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.823852 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: DELETE /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 HTTP/1.1 Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:20:32.825624 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.827143 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'dc0506b1-88fd-49f6-a2f5-88288c722940'} Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:32.828160 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.829778 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.831362 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:32.831362 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0276fffa-2a26-40fd-ad05-366f7966ea4e tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 404 len: 111 microversion: 2.1 time: 0.032496 Jul 24 01:20:32.831362 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 405/827] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:32 2022] DELETE /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:32.835760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:32.836410 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: dc0506b1-88fd-49f6-a2f5-88288c722940] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:32.843398 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.843850 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.844621 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.845056 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.858653 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 HTTP/1.1 Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:32.860256 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.861758 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': 'dc0506b1-88fd-49f6-a2f5-88288c722940'} Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:32.862600 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. Jul 24 01:20:32.864242 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.865673 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance dc0506b1-88fd-49f6-a2f5-88288c722940 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:32.865673 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8dcd4652-e0dd-4fd6-90ed-c3a2914e530d tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940" status: 404 len: 111 microversion: 2.1 time: 0.029746 Jul 24 01:20:32.865673 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 423/828] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:32 2022] GET /compute/v2.1/servers/dc0506b1-88fd-49f6-a2f5-88288c722940 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:20:32.870048 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:32.870548 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:32.876890 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.877408 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.878110 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.878540 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.892017 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: DELETE /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 HTTP/1.1 Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:20:32.893534 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.895054 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'c74d4adf-6c79-421f-b475-3eb478eb2124'} Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:32.896003 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.897225 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.898520 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:32.898520 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-de3ba329-1285-44de-b503-3c112c1d432b tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 404 len: 111 microversion: 2.1 time: 0.028716 Jul 24 01:20:32.898520 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 406/829] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:32 2022] DELETE /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:32.903775 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:32.904381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: c74d4adf-6c79-421f-b475-3eb478eb2124] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:32.910592 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.911036 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.911805 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.912234 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.926349 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 HTTP/1.1 Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:32.927925 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.929491 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': 'c74d4adf-6c79-421f-b475-3eb478eb2124'} Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:32.930510 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. Jul 24 01:20:32.931795 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:32.933006 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance c74d4adf-6c79-421f-b475-3eb478eb2124 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:32.933006 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-627af504-0d43-4414-bae6-25eb46b96ff5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124" status: 404 len: 111 microversion: 2.1 time: 0.029658 Jul 24 01:20:32.933006 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 424/830] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:32 2022] GET /compute/v2.1/servers/c74d4adf-6c79-421f-b475-3eb478eb2124 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:33.153495 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-1d3a3d6f-f7fd-45f5-8129-917713749308 req-edfeabce-5be9-4522-b221-b647521aa761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77065eb8-1786-49a7-b12a-f672a4ff9d6c", "name": "network-vif-plugged", "status": "completed", "tag": "55916731-c84b-4d9a-ac1d-58db6f0aed04"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:33.162098 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-1d3a3d6f-f7fd-45f5-8129-917713749308 req-edfeabce-5be9-4522-b221-b647521aa761 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:33.162878 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-1d3a3d6f-f7fd-45f5-8129-917713749308 req-edfeabce-5be9-4522-b221-b647521aa761 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:33.174998 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-1d3a3d6f-f7fd-45f5-8129-917713749308 req-edfeabce-5be9-4522-b221-b647521aa761 service nova] Creating event network-vif-plugged:55916731-c84b-4d9a-ac1d-58db6f0aed04 for instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c on hv-cinder-maste Jul 24 01:20:33.180280 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-1d3a3d6f-f7fd-45f5-8129-917713749308 req-edfeabce-5be9-4522-b221-b647521aa761 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030449 Jul 24 01:20:33.180876 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 407/831] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:20:33.810443 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:33.810972 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:33.817553 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:33.818004 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:33.818770 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:33.819208 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:33.823415 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:33.954009 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.962050 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.963647 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.964813 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0bdf2a41-5def-4743-8d7a-4969d53b7647 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1742 microversion: 2.20 time: 0.159563 Jul 24 01:20:33.965344 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 425/832] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:33 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:34.078998 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:34.079615 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:34.086363 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.086807 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.087681 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.088193 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.102923 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: DELETE /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 HTTP/1.1 Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:20:34.104582 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.106071 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'e5b4f90c-bd24-4e24-9175-7c8bb57f1245'} Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:34.106913 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.108410 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.110154 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:34.110154 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9385f5c8-6548-4e53-830c-47c55c7a38d8 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 404 len: 111 microversion: 2.1 time: 0.031640 Jul 24 01:20:34.110154 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 408/833] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:34 2022] DELETE /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:34.114621 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:34.115260 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] [instance: e5b4f90c-bd24-4e24-9175-7c8bb57f1245] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:34.121806 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.122284 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.123047 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.123530 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.137195 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] HTTP exception thrown: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Request method failure captured: Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 HTTP/1.1 Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3JxaMLTsY_3TXMCwmUXNrEeXHAs7kNYuoLDugPYCMygXOj35CRIHYR1w2IsfM5iA4BiS0qjx5uJfL35Wcdl26liFcOwJKHP5K8-W9qjB0n-AGoOZ1D5dlU2qxaT1FnmBZRzl5MHRx1e2vE8ECFTgefr59sDSTNbNbq0vrP1Ks3quKbs Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:34.138725 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6578102e5a746a584bcc9e4b2f64d46", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6578102e5a746a584bcc9e4b2f64d46"}]}] Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: b6578102e5a746a584bcc9e4b2f64d46 Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854930954 Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 1e7d0f401530454ba0cae0f5e9d6e0ce Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeNegativeTest-1854930954-project Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.140481 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': 'e5b4f90c-bd24-4e24-9175-7c8bb57f1245'} Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:34.141654 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. Jul 24 01:20:34.143099 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:34.144437 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] Returning 404 to user: Instance e5b4f90c-bd24-4e24-9175-7c8bb57f1245 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:34.144437 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4d943d9f-ebb1-44b1-ab4b-b437dba202b5 tempest-AttachVolumeNegativeTest-1854930954 tempest-AttachVolumeNegativeTest-1854930954-project] 10.222.0.42 "GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245" status: 404 len: 111 microversion: 2.1 time: 0.029494 Jul 24 01:20:34.144437 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 426/834] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:34 2022] GET /compute/v2.1/servers/e5b4f90c-bd24-4e24-9175-7c8bb57f1245 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:34.981874 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:34.982571 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:34.992378 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.992973 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.993873 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.994433 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:35.456156 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:35.467211 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:35.476496 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:35.480437 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-36a55a6a-6118-4c62-8b0a-96f9d3205641 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.501317 Jul 24 01:20:35.482642 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 409/835] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:34 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:36.506647 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:36.507289 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:36.515724 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.516431 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.517373 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.518443 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.857077 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:36.868137 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:36.870202 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:36.872352 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-87ca0fad-2d8e-4aca-a284-370703734488 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.375669 Jul 24 01:20:36.873329 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 427/836] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:36 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:37.891407 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:37.892020 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:37.907898 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:37.916165 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:37.918377 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:37.919789 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:38.188047 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:38.201324 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:38.203364 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:38.204816 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d90cedb4-5e81-4a04-9449-e71e54547715 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.317314 Jul 24 01:20:38.206089 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 410/837] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:37 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:39.226557 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:39.228573 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:39.239530 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:39.240242 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:39.241336 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:39.241934 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:39.447146 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.457860 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.459750 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.461419 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f16ae8f9-c40a-4950-b232-57c73960b746 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.238707 Jul 24 01:20:39.462175 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 428/838] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:39 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:40.429025 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-70c47738-0453-479d-bdea-2c6029e53288 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Action: 'create', calling method: .version_select at 0x7fdf3c095430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2138376876", "metadata": {"Type": "work"}}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-70c47738-0453-479d-bdea-2c6029e53288 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Request method failure captured: Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 122 Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3J5oL8nlb0yRE3Gkcg5Lmw1CDwr_zG2C4DI4KJtG4MEgXJdEcHw9Cp9OL7nO9Z-e_2mpFtVeuIXJg4UIkA-pCMOJPYCuAUtFc2OKHdOh1_3UA3PZteReU6obRgCDN_wzk9GGIinoH_h8QMMp6BRg3oocp8lJ9nG9OY8EChZy7zMD7ag Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:20:40.461373 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_675986aab65c4b25bd26b08635fdb742", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}] Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 33aaba928ec14925af5edcb79b615832 Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2138376876", "metadata": {"Type": "work"}}} Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: Jul 24 01:20:40.463140 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2138376876', 'metadata': {'Type': 'work'}}}} Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi '#$%' Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:40.464176 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:20:40.465825 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:20:40.467214 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 24 01:20:40.467214 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.468260 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-70c47738-0453-479d-bdea-2c6029e53288 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:40.469147 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-70c47738-0453-479d-bdea-2c6029e53288 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.362419 Jul 24 01:20:40.469727 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 411/839] 10.222.0.42 () {60 vars in 1155 bytes} [Sun Jul 24 01:20:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 364 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:40.479878 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2f55ef0a-e048-458b-b975-c1bc1fe5ffcc tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Action: 'create', calling method: .version_select at 0x7fdf3c0edc10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-106873370", "metadata": {"Type": "work"}}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2f55ef0a-e048-458b-b975-c1bc1fe5ffcc tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Request method failure captured: Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 119 Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3J5oL8nlb0yRE3Gkcg5Lmw1CDwr_zG2C4DI4KJtG4MEgXJdEcHw9Cp9OL7nO9Z-e_2mpFtVeuIXJg4UIkA-pCMOJPYCuAUtFc2OKHdOh1_3UA3PZteReU6obRgCDN_wzk9GGIinoH_h8QMMp6BRg3oocp8lJ9nG9OY8EChZy7zMD7ag Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:40.484532 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_675986aab65c4b25bd26b08635fdb742", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}] Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 33aaba928ec14925af5edcb79b615832 Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-106873370", "metadata": {"Type": "work"}}} Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: Jul 24 01:20:40.486184 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-106873370', 'metadata': {'Type': 'work'}}}} Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi '0' Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:40.487129 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:20:40.489283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:20:40.492208 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 24 01:20:40.492208 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.492208 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2f55ef0a-e048-458b-b975-c1bc1fe5ffcc tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:40.492208 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2f55ef0a-e048-458b-b975-c1bc1fe5ffcc tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010139 Jul 24 01:20:40.497222 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:40.497851 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:40.499855 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 429/840] 10.222.0.42 () {60 vars in 1155 bytes} [Sun Jul 24 01:20:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:40.505263 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2e98122d-52df-4750-b167-a2b40b860a00 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Action: 'create', calling method: .version_select at 0x7fdf3c0345e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1742028723", "metadata": {"Type": "work"}}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2e98122d-52df-4750-b167-a2b40b860a00 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Request method failure captured: Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 119 Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3J5oL8nlb0yRE3Gkcg5Lmw1CDwr_zG2C4DI4KJtG4MEgXJdEcHw9Cp9OL7nO9Z-e_2mpFtVeuIXJg4UIkA-pCMOJPYCuAUtFc2OKHdOh1_3UA3PZteReU6obRgCDN_wzk9GGIinoH_h8QMMp6BRg3oocp8lJ9nG9OY8EChZy7zMD7ag Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:40.507611 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_675986aab65c4b25bd26b08635fdb742", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}] Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 33aaba928ec14925af5edcb79b615832 Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1742028723", "metadata": {"Type": "work"}}} Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: Jul 24 01:20:40.509077 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1742028723', 'metadata': {'Type': 'work'}}}} Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi '' Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:40.509914 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:20:40.511247 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:20:40.513262 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 24 01:20:40.513262 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.513262 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2e98122d-52df-4750-b167-a2b40b860a00 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:40.513262 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2e98122d-52df-4750-b167-a2b40b860a00 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008111 Jul 24 01:20:40.513262 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 430/841] 10.222.0.42 () {60 vars in 1155 bytes} [Sun Jul 24 01:20:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:40.525456 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.526016 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.526806 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.527241 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.533874 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a03c09d4-04d0-4bb3-810c-2e02e9177f3e tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Calling method '.version_select at 0x7fdf3c1ee040>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:40.586293 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-a03c09d4-04d0-4bb3-810c-2e02e9177f3e tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] HTTP exception thrown: Volume tempest-invalid-354597150 could not be found. Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a03c09d4-04d0-4bb3-810c-2e02e9177f3e tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Request method failure captured: Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-354597150 HTTP/1.1 Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3J5oL8nlb0yRE3Gkcg5Lmw1CDwr_zG2C4DI4KJtG4MEgXJdEcHw9Cp9OL7nO9Z-e_2mpFtVeuIXJg4UIkA-pCMOJPYCuAUtFc2OKHdOh1_3UA3PZteReU6obRgCDN_wzk9GGIinoH_h8QMMp6BRg3oocp8lJ9nG9OY8EChZy7zMD7ag Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:40.592659 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_675986aab65c4b25bd26b08635fdb742", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}] Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 33aaba928ec14925af5edcb79b615832 Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Volume tempest-invalid-354597150 could not be found. Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': 'tempest-invalid-354597150'} Jul 24 01:20:40.594143 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-354597150 could not be found. (HTTP 404) (Request-ID: req-98eddebb-3d84-443f-bab7-4023d383fdc2) Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.594952 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:20:40.597174 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-354597150 could not be found. Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:40.598338 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-354597150 could not be found. Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-354597150 could not be found. Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a03c09d4-04d0-4bb3-810c-2e02e9177f3e tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Returning 404 to user: Volume tempest-invalid-354597150 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a03c09d4-04d0-4bb3-810c-2e02e9177f3e tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-354597150" status: 404 len: 98 microversion: 2.1 time: 0.075206 Jul 24 01:20:40.600409 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 431/842] 10.222.0.42 () {58 vars in 1214 bytes} [Sun Jul 24 01:20:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-354597150 => generated 98 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:20:40.606238 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-30a7b408-f161-4053-b217-5dbf06a8d9d3 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005019 Jul 24 01:20:40.611535 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 432/843] 10.222.0.42 () {58 vars in 1139 bytes} [Sun Jul 24 01:20:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 24 01:20:40.616885 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-44619ad5-8d4a-4aa1-a0a4-d97693d2c114 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004283 Jul 24 01:20:40.617395 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 433/844] 10.222.0.42 () {58 vars in 1136 bytes} [Sun Jul 24 01:20:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 24 01:20:40.627591 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-bb9685b6-52d1-4eb3-a60d-dad40eb7018a tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Calling method '.version_select at 0x7fdf3cb573a0>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:40.673240 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-bb9685b6-52d1-4eb3-a60d-dad40eb7018a tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] HTTP exception thrown: Volume 4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3 could not be found. Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-bb9685b6-52d1-4eb3-a60d-dad40eb7018a tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Request method failure captured: Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: DELETE /compute/v2.1/os-volumes/4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3 HTTP/1.1 Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3J5oL8nlb0yRE3Gkcg5Lmw1CDwr_zG2C4DI4KJtG4MEgXJdEcHw9Cp9OL7nO9Z-e_2mpFtVeuIXJg4UIkA-pCMOJPYCuAUtFc2OKHdOh1_3UA3PZteReU6obRgCDN_wzk9GGIinoH_h8QMMp6BRg3oocp8lJ9nG9OY8EChZy7zMD7ag Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:40.677821 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_675986aab65c4b25bd26b08635fdb742", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}] Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 33aaba928ec14925af5edcb79b615832 Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Volume 4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3 could not be found. Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3'} Jul 24 01:20:40.679477 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3 could not be found. (HTTP 404) (Request-ID: req-0f82fc63-685c-4cad-8f81-0e4e93ee88c4) Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.680351 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:20:40.681584 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3 could not be found. Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 24 01:20:40.682748 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3 could not be found. Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3 could not be found. Jul 24 01:20:40.683944 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.686558 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-bb9685b6-52d1-4eb3-a60d-dad40eb7018a tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Returning 404 to user: Volume 4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:40.687455 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-bb9685b6-52d1-4eb3-a60d-dad40eb7018a tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3" status: 404 len: 109 microversion: 2.1 time: 0.064070 Jul 24 01:20:40.691737 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 434/845] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:20:40 2022] DELETE /compute/v2.1/os-volumes/4c5cc863-a5d7-4b3e-bed6-bc998bfbfec3 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:40.698004 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-66f5ea71-c300-4e9c-9011-603549296a45 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Calling method '.version_select at 0x7fdf3ce818b0>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:40.747238 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:40.755286 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:40.757859 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-66f5ea71-c300-4e9c-9011-603549296a45 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] HTTP exception thrown: Volume 8e870954-da84-4893-8176-2d945a9d6452 could not be found. Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-66f5ea71-c300-4e9c-9011-603549296a45 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Request method failure captured: Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/os-volumes/8e870954-da84-4893-8176-2d945a9d6452 HTTP/1.1 Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3J5oL8nlb0yRE3Gkcg5Lmw1CDwr_zG2C4DI4KJtG4MEgXJdEcHw9Cp9OL7nO9Z-e_2mpFtVeuIXJg4UIkA-pCMOJPYCuAUtFc2OKHdOh1_3UA3PZteReU6obRgCDN_wzk9GGIinoH_h8QMMp6BRg3oocp8lJ9nG9OY8EChZy7zMD7ag Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:20:40.759877 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_675986aab65c4b25bd26b08635fdb742", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/675986aab65c4b25bd26b08635fdb742"}]}] Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 675986aab65c4b25bd26b08635fdb742 Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-VolumesNegativeTest-1237709864 Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 33aaba928ec14925af5edcb79b615832 Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-VolumesNegativeTest-1237709864-project Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Volume 8e870954-da84-4893-8176-2d945a9d6452 could not be found. Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '8e870954-da84-4893-8176-2d945a9d6452'} Jul 24 01:20:40.761233 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e870954-da84-4893-8176-2d945a9d6452 could not be found. (HTTP 404) (Request-ID: req-57fd5e51-13a1-413e-bd9a-15ea440c7467) Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.762120 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:20:40.763283 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e870954-da84-4893-8176-2d945a9d6452 could not be found. Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 24 01:20:40.764444 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e870954-da84-4893-8176-2d945a9d6452 could not be found. Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e870954-da84-4893-8176-2d945a9d6452 could not be found. Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-66f5ea71-c300-4e9c-9011-603549296a45 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] Returning 404 to user: Volume 8e870954-da84-4893-8176-2d945a9d6452 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-66f5ea71-c300-4e9c-9011-603549296a45 tempest-VolumesNegativeTest-1237709864 tempest-VolumesNegativeTest-1237709864-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/8e870954-da84-4893-8176-2d945a9d6452" status: 404 len: 109 microversion: 2.1 time: 0.067998 Jul 24 01:20:40.765634 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 435/846] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:20:40 2022] GET /compute/v2.1/os-volumes/8e870954-da84-4893-8176-2d945a9d6452 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:20:40.772512 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:40.773932 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c223bf83-33db-47cd-93a8-ca5cb8149065 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.280553 Jul 24 01:20:40.774706 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 412/847] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:40 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:41.794523 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:41.795656 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:41.807435 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.808191 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:41.809157 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.809748 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:42.044755 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:42.054454 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:42.056271 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:42.057807 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-cf38b124-c515-4044-b16e-7e300c5fcbfd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.270096 Jul 24 01:20:42.059871 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 436/848] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:41 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:43.078680 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:43.079885 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:43.087703 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:43.093239 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:43.094249 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:43.095990 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:43.321724 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:43.331614 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:43.333571 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:43.335418 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1229c91e-f2e6-4336-a498-282c5ed675a8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.261128 Jul 24 01:20:43.336842 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 413/849] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:43 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:44.359968 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:44.361941 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:44.368564 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:44.388490 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:44.388948 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:44.391714 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:44.393022 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:44.661412 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:44.676526 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:44.678340 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:44.679948 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-453ee05d-fb9d-4157-867e-90d433f2ebc8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.326590 Jul 24 01:20:44.681153 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 437/850] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:44 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:45.700324 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:45.700987 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:45.711095 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.712905 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.713761 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.715100 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.946069 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:45.957863 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:45.959954 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:45.961172 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d080c5dd-158f-4433-bf59-3bc3b36a61dd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.265023 Jul 24 01:20:45.962504 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 414/851] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:45 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:46.982295 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:46.982900 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:46.993229 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:46.993770 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:46.994808 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:46.995402 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:47.175625 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:47.185506 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:47.187374 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:47.188639 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2d4f6064-a1c6-4290-a266-0d7e90794478 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1737 microversion: 2.20 time: 0.210124 Jul 24 01:20:47.189201 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 438/852] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:46 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:48.207334 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:48.208864 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:48.212817 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:48.217685 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:48.218132 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:48.218892 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:48.219902 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:48.469775 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:48.478969 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:48.480870 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:48.483148 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9b1b5ae9-4071-48fd-96db-2172cdcb8c50 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1719 microversion: 2.20 time: 0.280833 Jul 24 01:20:48.484428 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 415/853] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:48 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1719 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:49.504003 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:49.504656 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:49.512096 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:49.512571 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:49.513344 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:49.513806 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:49.648192 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:49.656381 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:49.657884 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:49.659044 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-595e1ba5-85f8-4d1b-b876-5e26d47c7a24 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1719 microversion: 2.20 time: 0.159170 Jul 24 01:20:49.659632 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 439/854] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:49 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:50.681760 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:50.683059 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:50.695096 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:50.696233 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:50.697538 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:50.698156 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:50.838951 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:50.847212 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:50.848741 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:50.850028 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-fb4520c9-c4bb-4d83-8a20-57cb397400df tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1722 microversion: 2.20 time: 0.175009 Jul 24 01:20:50.850592 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 416/855] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:50 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:50.869005 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-939f011d-9355-4497-afac-eccecae45064 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6753be41-9a04-4128-af35-b3e70180ca4f"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:50.870140 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-939f011d-9355-4497-afac-eccecae45064 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:50.876450 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-939f011d-9355-4497-afac-eccecae45064 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:50.876894 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-939f011d-9355-4497-afac-eccecae45064 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:50.877641 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-939f011d-9355-4497-afac-eccecae45064 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:50.878066 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-939f011d-9355-4497-afac-eccecae45064 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.166690 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-939f011d-9355-4497-afac-eccecae45064 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302525 Jul 24 01:20:51.167511 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 440/856] 10.222.0.42 () {62 vars in 1363 bytes} [Sun Jul 24 01:20:50 2022] POST /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:20:51.214063 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-4493ab13-e4e5-4258-b727-394970e07c59 req-eba631ce-d3cf-407b-98e7-7c12902dd482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77065eb8-1786-49a7-b12a-f672a4ff9d6c", "name": "network-vif-unplugged", "status": "completed", "tag": "55916731-c84b-4d9a-ac1d-58db6f0aed04"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:51.223158 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-4493ab13-e4e5-4258-b727-394970e07c59 req-eba631ce-d3cf-407b-98e7-7c12902dd482 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.223158 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-4493ab13-e4e5-4258-b727-394970e07c59 req-eba631ce-d3cf-407b-98e7-7c12902dd482 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.234507 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.compute.server_external_events [req-4493ab13-e4e5-4258-b727-394970e07c59 req-eba631ce-d3cf-407b-98e7-7c12902dd482 service nova] Unable to find a host for instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c. Dropping event network-vif-unplugged {{(pid=118036) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 24 01:20:51.235379 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-4493ab13-e4e5-4258-b727-394970e07c59 req-eba631ce-d3cf-407b-98e7-7c12902dd482 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025815 Jul 24 01:20:51.236140 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 417/857] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 24 01:20:51.286717 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-dde73ec9-8a35-426d-b434-48fb30d64f8b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:51.287601 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-dde73ec9-8a35-426d-b434-48fb30d64f8b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:51.294932 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dde73ec9-8a35-426d-b434-48fb30d64f8b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.296333 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dde73ec9-8a35-426d-b434-48fb30d64f8b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.296564 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dde73ec9-8a35-426d-b434-48fb30d64f8b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.296941 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dde73ec9-8a35-426d-b434-48fb30d64f8b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.340744 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-77e0e2b9-bc2e-4280-90b4-5a4e0ea63d8d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:51.341272 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-77e0e2b9-bc2e-4280-90b4-5a4e0ea63d8d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:51.347829 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-77e0e2b9-bc2e-4280-90b4-5a4e0ea63d8d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.348274 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-77e0e2b9-bc2e-4280-90b4-5a4e0ea63d8d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.350366 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-77e0e2b9-bc2e-4280-90b4-5a4e0ea63d8d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.350978 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-77e0e2b9-bc2e-4280-90b4-5a4e0ea63d8d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.374323 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-77e0e2b9-bc2e-4280-90b4-5a4e0ea63d8d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lazy-loading 'flavor' on Instance uuid cb4800d3-ad11-46dd-90db-b763e1944b9e {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:51.399151 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-dde73ec9-8a35-426d-b434-48fb30d64f8b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/action" status: 202 len: 0 microversion: 2.20 time: 0.115653 Jul 24 01:20:51.399943 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 441/858] 10.222.0.42 () {62 vars in 1318 bytes} [Sun Jul 24 01:20:51 2022] POST /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:51.417051 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:51.417665 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:51.424738 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.425441 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.426526 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.427111 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.463631 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-77e0e2b9-bc2e-4280-90b4-5a4e0ea63d8d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "POST /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.136146 Jul 24 01:20:51.464474 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 418/859] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:20:51 2022] POST /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:20:51.472904 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b997590b-8566-4559-adb2-f8204601d203 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:51.473613 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b997590b-8566-4559-adb2-f8204601d203 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:51.480533 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b997590b-8566-4559-adb2-f8204601d203 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.481052 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b997590b-8566-4559-adb2-f8204601d203 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.481830 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b997590b-8566-4559-adb2-f8204601d203 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.482263 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b997590b-8566-4559-adb2-f8204601d203 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.699562 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:51.704099 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b997590b-8566-4559-adb2-f8204601d203 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:51.710756 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:51.712718 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:51.714005 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2de5801c-c28b-4aef-89f4-c2f899c0274a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1748 microversion: 2.20 time: 0.310105 Jul 24 01:20:51.714127 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b997590b-8566-4559-adb2-f8204601d203 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.245278 Jul 24 01:20:51.714568 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 442/860] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:51 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1748 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:20:51.714699 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 419/861] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:51 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:52.733298 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:52.734130 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:52.734711 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-557a2210-74d0-4e7c-887d-deee66b24d15 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:52.735784 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-557a2210-74d0-4e7c-887d-deee66b24d15 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:52.741809 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:52.742571 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:52.743680 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:52.744461 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:52.746581 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-557a2210-74d0-4e7c-887d-deee66b24d15 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:52.747288 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-557a2210-74d0-4e7c-887d-deee66b24d15 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:52.748399 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-557a2210-74d0-4e7c-887d-deee66b24d15 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:52.748984 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-557a2210-74d0-4e7c-887d-deee66b24d15 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:52.946455 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:52.956109 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-557a2210-74d0-4e7c-887d-deee66b24d15 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:52.957215 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:52.959533 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:52.961071 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a0538e36-a51c-409d-8f93-b1d5635d962f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1750 microversion: 2.20 time: 0.232913 Jul 24 01:20:52.962164 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 420/862] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:52 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1750 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:52.965865 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-557a2210-74d0-4e7c-887d-deee66b24d15 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.237776 Jul 24 01:20:52.966599 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 443/863] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:52 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:53.980280 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:53.980962 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:53.988319 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f4c4dce4-b973-4449-8c85-c85f4f6cc130 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:53.988931 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f4c4dce4-b973-4449-8c85-c85f4f6cc130 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:53.997608 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f4c4dce4-b973-4449-8c85-c85f4f6cc130 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:53.998057 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f4c4dce4-b973-4449-8c85-c85f4f6cc130 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:53.998841 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f4c4dce4-b973-4449-8c85-c85f4f6cc130 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:53.999430 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f4c4dce4-b973-4449-8c85-c85f4f6cc130 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:54.006886 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:54.007348 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:54.008159 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:54.008592 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:54.371124 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f4c4dce4-b973-4449-8c85-c85f4f6cc130 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:54.378954 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f4c4dce4-b973-4449-8c85-c85f4f6cc130 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.394340 Jul 24 01:20:54.388684 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 444/864] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:53 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:54.389603 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:54.398825 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:54.400516 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:54.401802 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-049db676-3761-44ee-97f9-cd1cfe73922d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.425742 Jul 24 01:20:54.402608 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 421/865] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:53 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:55.396253 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-aedc5d76-6e35-4ffe-9921-be7cc1471b06 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:55.397645 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-aedc5d76-6e35-4ffe-9921-be7cc1471b06 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:55.405095 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aedc5d76-6e35-4ffe-9921-be7cc1471b06 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:55.406045 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aedc5d76-6e35-4ffe-9921-be7cc1471b06 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:55.407273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aedc5d76-6e35-4ffe-9921-be7cc1471b06 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:55.408020 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-aedc5d76-6e35-4ffe-9921-be7cc1471b06 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:55.422371 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:55.423706 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:55.437327 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:55.438029 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:55.439176 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:55.439858 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:55.721671 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-aedc5d76-6e35-4ffe-9921-be7cc1471b06 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:55.730493 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:55.736595 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-aedc5d76-6e35-4ffe-9921-be7cc1471b06 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.344224 Jul 24 01:20:55.737508 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:55.739533 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 445/866] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:55 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:55.756968 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:55.760505 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:55.765455 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5d8dac24-4a7f-413d-bc76-3577a32f9aa1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.344638 Jul 24 01:20:55.766570 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 422/867] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:55 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:56.756056 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-de342aed-622b-42c8-9cfe-e648665bbf62 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:56.756705 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-de342aed-622b-42c8-9cfe-e648665bbf62 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:56.764409 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-de342aed-622b-42c8-9cfe-e648665bbf62 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:56.764769 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-de342aed-622b-42c8-9cfe-e648665bbf62 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:56.765520 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-de342aed-622b-42c8-9cfe-e648665bbf62 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:56.766036 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-de342aed-622b-42c8-9cfe-e648665bbf62 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:56.784096 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:56.784809 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:56.803954 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:56.809727 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:56.810961 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:56.811658 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:57.002621 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-de342aed-622b-42c8-9cfe-e648665bbf62 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:57.012223 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-de342aed-622b-42c8-9cfe-e648665bbf62 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.259299 Jul 24 01:20:57.013195 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 446/868] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:56 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:57.095339 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:57.099331 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:57.111465 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:57.115387 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:57.127398 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8fb35705-7ba3-4cff-b918-752cac5b275f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.346961 Jul 24 01:20:57.128297 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 423/869] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:56 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:58.029927 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a6a28846-c7b6-4ca5-9e67-6f0858195719 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:58.030688 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a6a28846-c7b6-4ca5-9e67-6f0858195719 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:58.037714 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a6a28846-c7b6-4ca5-9e67-6f0858195719 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:58.038222 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a6a28846-c7b6-4ca5-9e67-6f0858195719 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:58.038924 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a6a28846-c7b6-4ca5-9e67-6f0858195719 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:58.039413 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a6a28846-c7b6-4ca5-9e67-6f0858195719 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:58.147648 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:58.148855 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:58.156152 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:58.156572 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:58.157368 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:58.157756 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:58.194297 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a6a28846-c7b6-4ca5-9e67-6f0858195719 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:58.202066 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a6a28846-c7b6-4ca5-9e67-6f0858195719 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.176132 Jul 24 01:20:58.202730 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 447/870] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:58 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:58.298101 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:58.309433 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:58.311761 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:58.313953 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-bfde9197-37d8-4237-96ba-bee9cda7370d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.170328 Jul 24 01:20:58.325480 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 424/871] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:58 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:20:59.220530 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e020a9e6-a144-4b81-8d9a-eeb164267b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:59.221805 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e020a9e6-a144-4b81-8d9a-eeb164267b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:59.228751 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e020a9e6-a144-4b81-8d9a-eeb164267b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.229439 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e020a9e6-a144-4b81-8d9a-eeb164267b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:59.230370 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e020a9e6-a144-4b81-8d9a-eeb164267b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.231247 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e020a9e6-a144-4b81-8d9a-eeb164267b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:59.333568 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:59.335087 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:59.345414 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.346684 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:59.348088 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.348949 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:59.380354 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e020a9e6-a144-4b81-8d9a-eeb164267b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:59.420548 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e020a9e6-a144-4b81-8d9a-eeb164267b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.192016 Jul 24 01:20:59.427957 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 448/872] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:59 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:59.575948 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:59.597195 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:59.598673 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:59.599881 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-53c696db-c234-421d-bad5-4d1ff278f6b7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.271739 Jul 24 01:20:59.610631 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 425/873] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:59 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:21:00.445733 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a18e0ccd-ddbd-4954-8481-cc99d29f6fe9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:00.446609 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a18e0ccd-ddbd-4954-8481-cc99d29f6fe9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:00.453807 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a18e0ccd-ddbd-4954-8481-cc99d29f6fe9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:00.454274 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a18e0ccd-ddbd-4954-8481-cc99d29f6fe9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:00.455055 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a18e0ccd-ddbd-4954-8481-cc99d29f6fe9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:00.455625 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a18e0ccd-ddbd-4954-8481-cc99d29f6fe9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:00.618986 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:00.620349 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:00.627728 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:00.628438 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:00.629377 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:00.629953 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:00.692567 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a18e0ccd-ddbd-4954-8481-cc99d29f6fe9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:00.702631 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a18e0ccd-ddbd-4954-8481-cc99d29f6fe9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.261158 Jul 24 01:21:00.703844 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 449/874] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:00 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:00.840898 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:00.851542 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:00.853064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:00.854237 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d6f662b5-6ccd-4811-a7c1-5c8372202b8d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.239853 Jul 24 01:21:00.865630 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 426/875] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:00 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:01.721570 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-bfeb509c-c078-4de3-9dd4-9e38a081708e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:01.722451 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-bfeb509c-c078-4de3-9dd4-9e38a081708e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:01.729956 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bfeb509c-c078-4de3-9dd4-9e38a081708e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:01.730640 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bfeb509c-c078-4de3-9dd4-9e38a081708e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:01.731943 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bfeb509c-c078-4de3-9dd4-9e38a081708e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:01.732910 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bfeb509c-c078-4de3-9dd4-9e38a081708e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:01.874917 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:01.874917 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:01.880346 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:01.880800 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:01.881584 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:01.882009 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:01.907691 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-bfeb509c-c078-4de3-9dd4-9e38a081708e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:01.921049 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-bfeb509c-c078-4de3-9dd4-9e38a081708e tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.204419 Jul 24 01:21:01.924098 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 450/876] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:01 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:02.046327 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:02.057621 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:02.059281 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:02.068063 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-66231fcd-1977-430d-9336-0cce73911262 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.198990 Jul 24 01:21:02.070158 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 427/877] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:01 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:21:02.944588 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c97955fc-b8c8-49b8-a031-3ba01c1a5a3f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:02.945462 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c97955fc-b8c8-49b8-a031-3ba01c1a5a3f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:02.957084 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c97955fc-b8c8-49b8-a031-3ba01c1a5a3f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:02.960429 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c97955fc-b8c8-49b8-a031-3ba01c1a5a3f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:02.963414 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c97955fc-b8c8-49b8-a031-3ba01c1a5a3f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:02.964111 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c97955fc-b8c8-49b8-a031-3ba01c1a5a3f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:03.088988 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:03.090636 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:03.100137 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:03.101567 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:03.102592 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:03.103277 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:03.127012 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c97955fc-b8c8-49b8-a031-3ba01c1a5a3f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:03.136704 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c97955fc-b8c8-49b8-a031-3ba01c1a5a3f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.197412 Jul 24 01:21:03.149427 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 451/878] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:02 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:03.251637 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:03.260748 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:03.262260 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:03.263459 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1e60864e-1c3c-4a00-a102-ae720d539e83 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.178703 Jul 24 01:21:03.264009 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 428/879] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:03 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:21:04.156443 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a7136280-a6e7-494e-90ef-3cb3c5efade0 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:04.157760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a7136280-a6e7-494e-90ef-3cb3c5efade0 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:04.165935 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a7136280-a6e7-494e-90ef-3cb3c5efade0 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:04.165935 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a7136280-a6e7-494e-90ef-3cb3c5efade0 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:04.166500 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a7136280-a6e7-494e-90ef-3cb3c5efade0 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:04.167125 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a7136280-a6e7-494e-90ef-3cb3c5efade0 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:04.282026 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:04.282625 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:04.289360 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:04.289811 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:04.290694 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:04.291124 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:04.301299 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a7136280-a6e7-494e-90ef-3cb3c5efade0 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:04.309376 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a7136280-a6e7-494e-90ef-3cb3c5efade0 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.156931 Jul 24 01:21:04.310034 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 452/880] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:04 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:21:04.425967 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:04.434831 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:04.436378 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:04.437895 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b2ff748d-21cd-4ae6-b662-ad12e7346940 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.159896 Jul 24 01:21:04.438461 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 429/881] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:04 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:05.326546 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6502b77c-afb9-42e0-8315-e86a95756ac8 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:05.327153 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6502b77c-afb9-42e0-8315-e86a95756ac8 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:05.334383 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6502b77c-afb9-42e0-8315-e86a95756ac8 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:05.334825 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6502b77c-afb9-42e0-8315-e86a95756ac8 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:05.336063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6502b77c-afb9-42e0-8315-e86a95756ac8 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:05.336559 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6502b77c-afb9-42e0-8315-e86a95756ac8 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:05.456756 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:05.457383 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:05.464406 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:05.464855 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:05.465658 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:05.466062 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:05.563156 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6502b77c-afb9-42e0-8315-e86a95756ac8 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:05.571596 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6502b77c-afb9-42e0-8315-e86a95756ac8 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.249191 Jul 24 01:21:05.581371 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 453/882] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:05 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:05.630373 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:05.648453 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:05.650171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:05.651706 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c66b6ad8-5541-4055-9336-20092c2d9c0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.198933 Jul 24 01:21:05.652753 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 430/883] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:05 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:06.587979 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-21c720b7-74d0-4486-8778-c33979e14b47 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:06.588705 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-21c720b7-74d0-4486-8778-c33979e14b47 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:06.595306 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-21c720b7-74d0-4486-8778-c33979e14b47 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:06.595769 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-21c720b7-74d0-4486-8778-c33979e14b47 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:06.596521 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-21c720b7-74d0-4486-8778-c33979e14b47 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:06.596939 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-21c720b7-74d0-4486-8778-c33979e14b47 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:06.669949 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:06.670879 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:06.677573 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:06.678015 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:06.678919 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:06.679169 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:06.766651 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-21c720b7-74d0-4486-8778-c33979e14b47 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:06.775138 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-21c720b7-74d0-4486-8778-c33979e14b47 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.191025 Jul 24 01:21:06.775738 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 454/884] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:06 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:06.836264 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:06.844813 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:06.846301 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:06.847475 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7456b13d-8b8d-414a-bfda-a1964695290b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.181456 Jul 24 01:21:06.848031 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 431/885] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:06 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:07.792480 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f73c352a-f3ef-4f8e-b27d-83ebf58ece77 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:07.793126 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f73c352a-f3ef-4f8e-b27d-83ebf58ece77 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:07.800563 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f73c352a-f3ef-4f8e-b27d-83ebf58ece77 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:07.801011 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f73c352a-f3ef-4f8e-b27d-83ebf58ece77 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:07.801808 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f73c352a-f3ef-4f8e-b27d-83ebf58ece77 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:07.802264 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f73c352a-f3ef-4f8e-b27d-83ebf58ece77 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:07.868294 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:07.868958 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:07.877231 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:07.877679 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:07.878425 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:07.879075 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:07.989928 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f73c352a-f3ef-4f8e-b27d-83ebf58ece77 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:07.998125 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f73c352a-f3ef-4f8e-b27d-83ebf58ece77 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.209481 Jul 24 01:21:07.998917 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 455/886] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:07 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:08.044330 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:08.056051 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:08.057574 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:08.059044 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-20235148-6182-4dbd-9c96-f787558d29a7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.197145 Jul 24 01:21:08.063396 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 432/887] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:07 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:09.019989 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a8cd82c2-1087-4cdb-b08a-43ced1604b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:09.020855 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a8cd82c2-1087-4cdb-b08a-43ced1604b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:09.029358 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a8cd82c2-1087-4cdb-b08a-43ced1604b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:09.029805 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a8cd82c2-1087-4cdb-b08a-43ced1604b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:09.030565 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a8cd82c2-1087-4cdb-b08a-43ced1604b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:09.030990 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a8cd82c2-1087-4cdb-b08a-43ced1604b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:09.077798 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:09.078412 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:09.085495 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:09.085946 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:09.086711 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:09.087227 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:09.223718 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a8cd82c2-1087-4cdb-b08a-43ced1604b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:09.232514 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a8cd82c2-1087-4cdb-b08a-43ced1604b09 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.218868 Jul 24 01:21:09.233059 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 456/888] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:09 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:09.260119 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:09.268897 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:09.270427 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:09.271646 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ee9e64f9-89a9-4f3a-a9dd-aee1b8539572 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.197764 Jul 24 01:21:09.282485 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 433/889] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:09 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:10.262643 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7a005f1b-a0f3-4cd2-8c4e-5e7ea40a3324 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:10.263747 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7a005f1b-a0f3-4cd2-8c4e-5e7ea40a3324 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:10.275048 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7a005f1b-a0f3-4cd2-8c4e-5e7ea40a3324 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:10.275885 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7a005f1b-a0f3-4cd2-8c4e-5e7ea40a3324 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:10.277143 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7a005f1b-a0f3-4cd2-8c4e-5e7ea40a3324 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:10.277873 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7a005f1b-a0f3-4cd2-8c4e-5e7ea40a3324 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:10.292550 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:10.293160 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:10.300385 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:10.300831 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:10.301594 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:10.302030 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:10.483704 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7a005f1b-a0f3-4cd2-8c4e-5e7ea40a3324 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:10.489565 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:10.500002 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7a005f1b-a0f3-4cd2-8c4e-5e7ea40a3324 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.244051 Jul 24 01:21:10.501399 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:10.502897 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:10.505335 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-944a6344-8067-4a50-9b0c-d8c14b6cd241 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.217776 Jul 24 01:21:10.506276 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 434/890] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:10 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:10.506985 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 457/891] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:10 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:11.525765 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-57e67261-fc09-4792-bfa8-1595d2719348 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:11.526394 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-57e67261-fc09-4792-bfa8-1595d2719348 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:11.526798 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:11.527999 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:11.535032 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57e67261-fc09-4792-bfa8-1595d2719348 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:11.535512 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:11.535777 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57e67261-fc09-4792-bfa8-1595d2719348 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:11.536186 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:11.536897 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57e67261-fc09-4792-bfa8-1595d2719348 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:11.537445 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:11.537570 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-57e67261-fc09-4792-bfa8-1595d2719348 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:11.538203 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:11.766608 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:11.772319 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-57e67261-fc09-4792-bfa8-1595d2719348 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:11.777664 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:11.779607 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:11.782091 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2cb0fcd8-6189-4aea-999b-158d325fb898 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.261143 Jul 24 01:21:11.783011 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 435/892] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:11 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:21:11.783507 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-57e67261-fc09-4792-bfa8-1595d2719348 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.262076 Jul 24 01:21:11.793763 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 458/893] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:11 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:12.800947 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:12.801506 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f0b6f9d1-9bc5-4c89-b3ad-99a38ffd9cce tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:12.801950 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:12.802099 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f0b6f9d1-9bc5-4c89-b3ad-99a38ffd9cce tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:12.807991 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:12.808633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:12.809592 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:12.810184 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:12.814135 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f0b6f9d1-9bc5-4c89-b3ad-99a38ffd9cce tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:12.814583 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f0b6f9d1-9bc5-4c89-b3ad-99a38ffd9cce tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:12.815367 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f0b6f9d1-9bc5-4c89-b3ad-99a38ffd9cce tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:12.815961 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f0b6f9d1-9bc5-4c89-b3ad-99a38ffd9cce tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:13.013146 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:13.016569 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f0b6f9d1-9bc5-4c89-b3ad-99a38ffd9cce tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:13.022446 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:13.024015 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:13.024777 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f0b6f9d1-9bc5-4c89-b3ad-99a38ffd9cce tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1509 microversion: 2.1 time: 0.227332 Jul 24 01:21:13.025213 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-60cfc6aa-9136-4a0c-873e-85dda5405427 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.228137 Jul 24 01:21:13.025649 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 459/894] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:12 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:13.035776 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 436/895] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:12 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:13.041161 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3c0b934e-4166-4811-b8cf-e3677d6a5ca3 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:13.041722 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3c0b934e-4166-4811-b8cf-e3677d6a5ca3 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:13.048129 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3c0b934e-4166-4811-b8cf-e3677d6a5ca3 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:13.048559 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3c0b934e-4166-4811-b8cf-e3677d6a5ca3 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:13.049317 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3c0b934e-4166-4811-b8cf-e3677d6a5ca3 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:13.049764 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3c0b934e-4166-4811-b8cf-e3677d6a5ca3 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:13.137610 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c0b934e-4166-4811-b8cf-e3677d6a5ca3 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [7e53ccc9-30c5-4387-b90d-cd2a6a2dec2b] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 01:21:13.345257 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-e146837a-dc7b-4aee-9dcf-f32718d54be5 req-61ecaf9d-df5e-4501-afa4-42d11d8f2061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77065eb8-1786-49a7-b12a-f672a4ff9d6c", "name": "network-vif-plugged", "status": "completed", "tag": "55916731-c84b-4d9a-ac1d-58db6f0aed04"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:13.355206 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-e146837a-dc7b-4aee-9dcf-f32718d54be5 req-61ecaf9d-df5e-4501-afa4-42d11d8f2061 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:13.355698 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-e146837a-dc7b-4aee-9dcf-f32718d54be5 req-61ecaf9d-df5e-4501-afa4-42d11d8f2061 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:13.367448 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-e146837a-dc7b-4aee-9dcf-f32718d54be5 req-61ecaf9d-df5e-4501-afa4-42d11d8f2061 service nova] Creating event network-vif-plugged:55916731-c84b-4d9a-ac1d-58db6f0aed04 for instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c on hv-cinder-maste Jul 24 01:21:13.372572 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-e146837a-dc7b-4aee-9dcf-f32718d54be5 req-61ecaf9d-df5e-4501-afa4-42d11d8f2061 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033412 Jul 24 01:21:13.373460 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 460/896] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:21:14.044533 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:14.045777 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:14.052221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:14.052668 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:14.053418 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:14.053851 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:14.148369 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c0b934e-4166-4811-b8cf-e3677d6a5ca3 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [7e53ccc9-30c5-4387-b90d-cd2a6a2dec2b] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 34366. Jul 24 01:21:14.152929 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3c0b934e-4166-4811-b8cf-e3677d6a5ca3 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "POST /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e/action" status: 202 len: 0 microversion: 2.1 time: 1.115497 Jul 24 01:21:14.154033 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 437/897] 10.222.0.42 () {60 vars in 1277 bytes} [Sun Jul 24 01:21:13 2022] POST /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e/action => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:21:14.163573 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9238cfe7-5b2d-4c0f-9f25-e49519acbbc7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:14.164605 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9238cfe7-5b2d-4c0f-9f25-e49519acbbc7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:14.176094 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9238cfe7-5b2d-4c0f-9f25-e49519acbbc7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:14.176929 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9238cfe7-5b2d-4c0f-9f25-e49519acbbc7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:14.178094 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9238cfe7-5b2d-4c0f-9f25-e49519acbbc7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:14.178887 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9238cfe7-5b2d-4c0f-9f25-e49519acbbc7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:14.208334 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:14.222115 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:14.223929 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:14.225177 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-688b31e4-8ddd-4279-b3a5-bdd7954ab27b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.185743 Jul 24 01:21:14.225754 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 461/898] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:14 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:14.335403 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9238cfe7-5b2d-4c0f-9f25-e49519acbbc7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:14.343544 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9238cfe7-5b2d-4c0f-9f25-e49519acbbc7 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1517 microversion: 2.1 time: 0.185313 Jul 24 01:21:14.344233 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 438/899] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:14 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:21:15.244652 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:15.246646 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:15.250580 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=52 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:15.257790 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:15.258624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:15.259821 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:15.260434 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:15.360695 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b35df2a9-03e3-463e-8233-95114e49da8a tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:15.361340 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b35df2a9-03e3-463e-8233-95114e49da8a tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:15.374399 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b35df2a9-03e3-463e-8233-95114e49da8a tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:15.374399 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b35df2a9-03e3-463e-8233-95114e49da8a tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:15.374399 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b35df2a9-03e3-463e-8233-95114e49da8a tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:15.374399 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b35df2a9-03e3-463e-8233-95114e49da8a tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:15.414528 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:15.415877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:15.425495 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:15.427001 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:15.428249 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d7e194f2-aa53-441d-bbda-0a8b931eb72c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.188409 Jul 24 01:21:15.428775 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 462/900] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:15 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:15.445043 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-7a7589d1-ee7d-43e7-96d7-3550d01e4f8c req-1f6b6bf0-6303-42f5-94b6-85b3ad61655d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4800d3-ad11-46dd-90db-b763e1944b9e", "name": "network-vif-unplugged", "status": "completed", "tag": "a4e927a5-ea6b-4827-aa7b-42a260b70350"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:15.465641 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-7a7589d1-ee7d-43e7-96d7-3550d01e4f8c req-1f6b6bf0-6303-42f5-94b6-85b3ad61655d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:15.466089 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-7a7589d1-ee7d-43e7-96d7-3550d01e4f8c req-1f6b6bf0-6303-42f5-94b6-85b3ad61655d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:15.470966 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=100 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:15.486531 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.compute.server_external_events [req-7a7589d1-ee7d-43e7-96d7-3550d01e4f8c req-1f6b6bf0-6303-42f5-94b6-85b3ad61655d service nova] Unable to find a host for instance cb4800d3-ad11-46dd-90db-b763e1944b9e. Dropping event network-vif-unplugged {{(pid=118035) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 24 01:21:15.487789 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-7a7589d1-ee7d-43e7-96d7-3550d01e4f8c req-1f6b6bf0-6303-42f5-94b6-85b3ad61655d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057606 Jul 24 01:21:15.492005 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 463/901] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 24 01:21:15.557812 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b35df2a9-03e3-463e-8233-95114e49da8a tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:15.565508 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b35df2a9-03e3-463e-8233-95114e49da8a tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1517 microversion: 2.1 time: 0.208866 Jul 24 01:21:15.566065 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 439/902] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:15 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1517 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:16.449917 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:16.450505 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:16.457567 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:16.458065 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:16.458853 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:16.459334 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:16.585895 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-66ba79f5-204c-4bec-a244-23dc8236224d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:16.586640 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-66ba79f5-204c-4bec-a244-23dc8236224d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:16.594009 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-66ba79f5-204c-4bec-a244-23dc8236224d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:16.594517 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-66ba79f5-204c-4bec-a244-23dc8236224d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:16.595487 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-66ba79f5-204c-4bec-a244-23dc8236224d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:16.595970 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-66ba79f5-204c-4bec-a244-23dc8236224d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:16.602795 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:16.623561 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:16.625069 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:16.626230 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-be5cd09b-685f-4762-8e0d-9cabf0b545ae tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1806 microversion: 2.20 time: 0.181134 Jul 24 01:21:16.628969 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 464/903] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:16 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:16.733462 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-66ba79f5-204c-4bec-a244-23dc8236224d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:16.741307 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-66ba79f5-204c-4bec-a244-23dc8236224d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1517 microversion: 2.1 time: 0.162966 Jul 24 01:21:16.741896 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 440/904] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:16 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:17.651255 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:17.652018 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:17.659039 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:17.659518 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:17.660284 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:17.660853 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:17.758353 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-47b21e34-39bc-4404-9b46-d4f51d70c7c5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:17.758982 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-47b21e34-39bc-4404-9b46-d4f51d70c7c5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:17.766079 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-47b21e34-39bc-4404-9b46-d4f51d70c7c5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:17.766522 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-47b21e34-39bc-4404-9b46-d4f51d70c7c5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:17.767288 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-47b21e34-39bc-4404-9b46-d4f51d70c7c5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:17.767758 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-47b21e34-39bc-4404-9b46-d4f51d70c7c5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:17.791670 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:17.800948 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:17.802564 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:17.803748 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-96d012bc-ad6e-49f4-97e7-bf8f31551353 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1793 microversion: 2.20 time: 0.158471 Jul 24 01:21:17.804334 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 465/905] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:17 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1793 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:17.901376 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-47b21e34-39bc-4404-9b46-d4f51d70c7c5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:17.908918 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-47b21e34-39bc-4404-9b46-d4f51d70c7c5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1517 microversion: 2.1 time: 0.154589 Jul 24 01:21:17.909453 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 441/906] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:17 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:18.930916 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-2ecc8bb0-a2dc-47b3-89b8-9b73f3d6e027 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:18.932175 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-2ecc8bb0-a2dc-47b3-89b8-9b73f3d6e027 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:18.939846 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2ecc8bb0-a2dc-47b3-89b8-9b73f3d6e027 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:18.940403 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2ecc8bb0-a2dc-47b3-89b8-9b73f3d6e027 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:18.941255 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2ecc8bb0-a2dc-47b3-89b8-9b73f3d6e027 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:18.941752 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-2ecc8bb0-a2dc-47b3-89b8-9b73f3d6e027 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:19.084055 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-2ecc8bb0-a2dc-47b3-89b8-9b73f3d6e027 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:19.092697 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-2ecc8bb0-a2dc-47b3-89b8-9b73f3d6e027 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1517 microversion: 2.1 time: 0.168282 Jul 24 01:21:19.093293 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 466/907] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:18 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:20.112289 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1fea409a-00ab-49a1-9fef-2d16fd5ddf75 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:20.113918 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1fea409a-00ab-49a1-9fef-2d16fd5ddf75 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:20.120134 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=56 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:20.121694 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1fea409a-00ab-49a1-9fef-2d16fd5ddf75 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:20.122176 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1fea409a-00ab-49a1-9fef-2d16fd5ddf75 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:20.123058 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1fea409a-00ab-49a1-9fef-2d16fd5ddf75 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:20.123544 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1fea409a-00ab-49a1-9fef-2d16fd5ddf75 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:20.492697 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1fea409a-00ab-49a1-9fef-2d16fd5ddf75 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:20.500499 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1fea409a-00ab-49a1-9fef-2d16fd5ddf75 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1575 microversion: 2.1 time: 0.394143 Jul 24 01:21:20.501096 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 442/908] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:20 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1575 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:21.516956 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-48a4f839-cc7a-4e9e-9dd8-f1f156a76bed tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:21.517599 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-48a4f839-cc7a-4e9e-9dd8-f1f156a76bed tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:21.523627 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-48a4f839-cc7a-4e9e-9dd8-f1f156a76bed tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:21.524071 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-48a4f839-cc7a-4e9e-9dd8-f1f156a76bed tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:21.524833 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-48a4f839-cc7a-4e9e-9dd8-f1f156a76bed tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:21.525265 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-48a4f839-cc7a-4e9e-9dd8-f1f156a76bed tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:21.699682 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-48a4f839-cc7a-4e9e-9dd8-f1f156a76bed tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:21.707583 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-48a4f839-cc7a-4e9e-9dd8-f1f156a76bed tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1575 microversion: 2.1 time: 0.194409 Jul 24 01:21:21.708161 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 467/909] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:21 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:22.724785 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-81e3c840-7112-451c-8f9d-4e71bad14d63 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:22.725390 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-81e3c840-7112-451c-8f9d-4e71bad14d63 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:22.732542 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81e3c840-7112-451c-8f9d-4e71bad14d63 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:22.732917 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81e3c840-7112-451c-8f9d-4e71bad14d63 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:22.733676 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81e3c840-7112-451c-8f9d-4e71bad14d63 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:22.734102 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-81e3c840-7112-451c-8f9d-4e71bad14d63 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:22.893333 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-81e3c840-7112-451c-8f9d-4e71bad14d63 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:22.901143 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-81e3c840-7112-451c-8f9d-4e71bad14d63 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1575 microversion: 2.1 time: 0.180151 Jul 24 01:21:22.901671 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 443/910] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:22 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:23.918063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-919a5fae-f552-4b16-9b39-4119ff6b30dc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:23.918832 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-919a5fae-f552-4b16-9b39-4119ff6b30dc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:23.925963 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-919a5fae-f552-4b16-9b39-4119ff6b30dc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:23.926412 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-919a5fae-f552-4b16-9b39-4119ff6b30dc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:23.927177 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-919a5fae-f552-4b16-9b39-4119ff6b30dc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:23.927650 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-919a5fae-f552-4b16-9b39-4119ff6b30dc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:24.057863 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-919a5fae-f552-4b16-9b39-4119ff6b30dc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:24.065707 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-919a5fae-f552-4b16-9b39-4119ff6b30dc tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1575 microversion: 2.1 time: 0.151559 Jul 24 01:21:24.066264 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 468/911] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:23 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:25.085942 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-cb1b3411-c4a6-4a41-8c84-541925c9bd98 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:25.086866 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-cb1b3411-c4a6-4a41-8c84-541925c9bd98 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:25.094392 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb1b3411-c4a6-4a41-8c84-541925c9bd98 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:25.094839 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb1b3411-c4a6-4a41-8c84-541925c9bd98 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:25.095716 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb1b3411-c4a6-4a41-8c84-541925c9bd98 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:25.096154 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cb1b3411-c4a6-4a41-8c84-541925c9bd98 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:25.238418 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cb1b3411-c4a6-4a41-8c84-541925c9bd98 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:25.249115 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-cb1b3411-c4a6-4a41-8c84-541925c9bd98 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1575 microversion: 2.1 time: 0.169279 Jul 24 01:21:25.249697 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 444/912] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:25 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:26.270241 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-09d67eaf-7cd6-4452-9adf-c245df909fb9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:26.271163 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-09d67eaf-7cd6-4452-9adf-c245df909fb9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:26.279855 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09d67eaf-7cd6-4452-9adf-c245df909fb9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:26.280307 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09d67eaf-7cd6-4452-9adf-c245df909fb9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:26.281069 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09d67eaf-7cd6-4452-9adf-c245df909fb9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:26.281503 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-09d67eaf-7cd6-4452-9adf-c245df909fb9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:26.415832 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-09d67eaf-7cd6-4452-9adf-c245df909fb9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:26.424222 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-09d67eaf-7cd6-4452-9adf-c245df909fb9 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1575 microversion: 2.1 time: 0.159987 Jul 24 01:21:26.425211 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 469/913] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:26 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:27.411238 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-ef6fabe2-a841-4748-96d2-6047152db47d req-e4f0f866-dc76-4035-8aef-3970c649aa28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4800d3-ad11-46dd-90db-b763e1944b9e", "name": "network-vif-plugged", "status": "completed", "tag": "a4e927a5-ea6b-4827-aa7b-42a260b70350"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:27.421875 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-ef6fabe2-a841-4748-96d2-6047152db47d req-e4f0f866-dc76-4035-8aef-3970c649aa28 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:27.422330 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-ef6fabe2-a841-4748-96d2-6047152db47d req-e4f0f866-dc76-4035-8aef-3970c649aa28 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:27.436078 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-ef6fabe2-a841-4748-96d2-6047152db47d req-e4f0f866-dc76-4035-8aef-3970c649aa28 service nova] Creating event network-vif-plugged:a4e927a5-ea6b-4827-aa7b-42a260b70350 for instance cb4800d3-ad11-46dd-90db-b763e1944b9e on hv-cinder-maste Jul 24 01:21:27.441646 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-ef6fabe2-a841-4748-96d2-6047152db47d req-e4f0f866-dc76-4035-8aef-3970c649aa28 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 Jul 24 01:21:27.442553 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 445/914] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:27.444476 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-80f713d3-2025-4ba0-9eae-3a1261d29d0b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:27.445978 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-80f713d3-2025-4ba0-9eae-3a1261d29d0b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:27.454418 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-80f713d3-2025-4ba0-9eae-3a1261d29d0b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:27.454873 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-80f713d3-2025-4ba0-9eae-3a1261d29d0b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:27.455681 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-80f713d3-2025-4ba0-9eae-3a1261d29d0b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:27.456124 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-80f713d3-2025-4ba0-9eae-3a1261d29d0b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:27.892104 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-80f713d3-2025-4ba0-9eae-3a1261d29d0b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:27.899864 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-80f713d3-2025-4ba0-9eae-3a1261d29d0b tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1575 microversion: 2.1 time: 0.460305 Jul 24 01:21:27.900447 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 470/915] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:27 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1575 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:28.922518 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ff8f2643-710b-4f3f-994d-b2f185d8e41d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:28.923712 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ff8f2643-710b-4f3f-994d-b2f185d8e41d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:28.934409 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ff8f2643-710b-4f3f-994d-b2f185d8e41d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:28.935148 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ff8f2643-710b-4f3f-994d-b2f185d8e41d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:28.936461 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ff8f2643-710b-4f3f-994d-b2f185d8e41d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:28.937196 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ff8f2643-710b-4f3f-994d-b2f185d8e41d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:29.073203 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ff8f2643-710b-4f3f-994d-b2f185d8e41d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:29.081664 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ff8f2643-710b-4f3f-994d-b2f185d8e41d tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1575 microversion: 2.1 time: 0.167152 Jul 24 01:21:29.082226 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 446/916] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:28 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:30.098924 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4c2a4a71-0de5-4f57-bfbf-344292db1f4f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:30.099616 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4c2a4a71-0de5-4f57-bfbf-344292db1f4f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:30.107045 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4c2a4a71-0de5-4f57-bfbf-344292db1f4f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:30.107587 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4c2a4a71-0de5-4f57-bfbf-344292db1f4f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:30.108432 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4c2a4a71-0de5-4f57-bfbf-344292db1f4f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:30.108917 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4c2a4a71-0de5-4f57-bfbf-344292db1f4f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:30.250649 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-4c2a4a71-0de5-4f57-bfbf-344292db1f4f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:30.258787 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4c2a4a71-0de5-4f57-bfbf-344292db1f4f tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1562 microversion: 2.1 time: 0.164250 Jul 24 01:21:30.259388 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 471/917] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:30 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:41.123053 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:21:41.123053 dv-cinder-master-3-smb devstack@n-api.service[118035]: Sun Jul 24 01:21:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:22:17.248331 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f9fe3a78-69bf-469b-86da-cae6d89f8439 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:17.249275 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f9fe3a78-69bf-469b-86da-cae6d89f8439 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:17.252814 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=9 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:17.253880 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=40 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:17.261338 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f9fe3a78-69bf-469b-86da-cae6d89f8439 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.261804 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f9fe3a78-69bf-469b-86da-cae6d89f8439 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.262569 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f9fe3a78-69bf-469b-86da-cae6d89f8439 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.263007 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f9fe3a78-69bf-469b-86da-cae6d89f8439 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.292931 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f9fe3a78-69bf-469b-86da-cae6d89f8439 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments/6753be41-9a04-4128-af35-b3e70180ca4f" status: 200 len: 194 microversion: 2.20 time: 0.051298 Jul 24 01:22:17.293527 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 447/918] 10.222.0.42 () {60 vars in 1453 bytes} [Sun Jul 24 01:22:17 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments/6753be41-9a04-4128-af35-b3e70180ca4f => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:22:17.361238 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-928ccb94-3681-426d-8dd2-b92d4045c202 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:17.361798 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-928ccb94-3681-426d-8dd2-b92d4045c202 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:17.364051 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=19 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:17.364693 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=48 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:17.371325 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-928ccb94-3681-426d-8dd2-b92d4045c202 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.371771 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-928ccb94-3681-426d-8dd2-b92d4045c202 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.372526 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-928ccb94-3681-426d-8dd2-b92d4045c202 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.372955 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-928ccb94-3681-426d-8dd2-b92d4045c202 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.680304 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-928ccb94-3681-426d-8dd2-b92d4045c202 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lazy-loading 'services' on Instance uuid 77065eb8-1786-49a7-b12a-f672a4ff9d6c {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:22:17.763448 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-928ccb94-3681-426d-8dd2-b92d4045c202 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments/6753be41-9a04-4128-af35-b3e70180ca4f" status: 202 len: 0 microversion: 2.20 time: 0.405992 Jul 24 01:22:17.764028 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 472/919] 10.222.0.42 () {60 vars in 1456 bytes} [Sun Jul 24 01:22:17 2022] DELETE /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments/6753be41-9a04-4128-af35-b3e70180ca4f => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:22:17.772579 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-83571b19-5672-4f29-8d0b-3649d13db4d8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:17.773783 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-83571b19-5672-4f29-8d0b-3649d13db4d8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:17.779958 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-83571b19-5672-4f29-8d0b-3649d13db4d8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.780393 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-83571b19-5672-4f29-8d0b-3649d13db4d8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.781145 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-83571b19-5672-4f29-8d0b-3649d13db4d8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.781581 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-83571b19-5672-4f29-8d0b-3649d13db4d8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.812386 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-83571b19-5672-4f29-8d0b-3649d13db4d8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043602 Jul 24 01:22:17.812841 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 448/920] 10.222.0.42 () {60 vars in 1342 bytes} [Sun Jul 24 01:22:17 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:22:18.826350 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8504afad-d189-4233-aa58-cac64ea2355a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:18.827464 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8504afad-d189-4233-aa58-cac64ea2355a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:18.834333 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8504afad-d189-4233-aa58-cac64ea2355a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:18.834776 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8504afad-d189-4233-aa58-cac64ea2355a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:18.835602 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8504afad-d189-4233-aa58-cac64ea2355a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:18.836031 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8504afad-d189-4233-aa58-cac64ea2355a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:18.864632 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8504afad-d189-4233-aa58-cac64ea2355a tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043325 Jul 24 01:22:18.865171 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 473/921] 10.222.0.42 () {60 vars in 1342 bytes} [Sun Jul 24 01:22:18 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:18.923876 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-823242f2-89f9-469f-a49e-85751386a04f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:18.924369 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-823242f2-89f9-469f-a49e-85751386a04f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:18.931042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-823242f2-89f9-469f-a49e-85751386a04f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:18.931532 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-823242f2-89f9-469f-a49e-85751386a04f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:18.932295 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-823242f2-89f9-469f-a49e-85751386a04f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:18.932721 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-823242f2-89f9-469f-a49e-85751386a04f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:18.958793 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-823242f2-89f9-469f-a49e-85751386a04f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Going to try to terminate instance {{(pid=118036) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:22:19.049842 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-823242f2-89f9-469f-a49e-85751386a04f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 204 len: 0 microversion: 2.20 time: 0.129709 Jul 24 01:22:19.050727 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 449/922] 10.222.0.42 () {60 vars in 1279 bytes} [Sun Jul 24 01:22:18 2022] DELETE /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:22:19.059601 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:19.060216 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:19.066383 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:19.066839 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:19.067637 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:19.068082 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:19.198462 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:19.206582 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:19.208202 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:19.209473 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a4c4ef34-0d4b-45b9-a437-1bbd934ed9e8 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.153914 Jul 24 01:22:19.210042 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 474/923] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:19 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:20.232757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:20.233957 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:20.245047 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:20.245825 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:20.247112 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:20.247974 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:20.504119 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:20.517012 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:20.519282 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:20.520883 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-53d06e81-1652-4b2f-a8c5-5be2131e57bc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1721 microversion: 2.20 time: 0.295302 Jul 24 01:22:20.521663 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 450/924] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:20 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:21.540021 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:21.540641 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:21.547615 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:21.548063 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:21.549195 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:21.549347 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:21.632235 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:21.640678 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:21.642178 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:21.643342 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f25b0e1b-7a56-4623-978c-f9381bd54277 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 200 len: 1654 microversion: 2.20 time: 0.107427 Jul 24 01:22:21.643941 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 475/925] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:21 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 1654 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:21.740241 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-26650dc9-3a49-43ea-a6d7-4bbb9249315f req-623a7d61-219f-4a8c-80c3-4f881afbd281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77065eb8-1786-49a7-b12a-f672a4ff9d6c", "name": "network-vif-deleted", "tag": "55916731-c84b-4d9a-ac1d-58db6f0aed04"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:21.748445 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-26650dc9-3a49-43ea-a6d7-4bbb9249315f req-623a7d61-219f-4a8c-80c3-4f881afbd281 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:21.748969 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-26650dc9-3a49-43ea-a6d7-4bbb9249315f req-623a7d61-219f-4a8c-80c3-4f881afbd281 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:21.761527 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-26650dc9-3a49-43ea-a6d7-4bbb9249315f req-623a7d61-219f-4a8c-80c3-4f881afbd281 service nova] Creating event network-vif-deleted:55916731-c84b-4d9a-ac1d-58db6f0aed04 for instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c on hv-cinder-maste Jul 24 01:22:21.767061 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-26650dc9-3a49-43ea-a6d7-4bbb9249315f req-623a7d61-219f-4a8c-80c3-4f881afbd281 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030403 Jul 24 01:22:21.768109 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 451/926] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:22.662017 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:22.662592 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:22.670002 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:22.670455 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:22.671219 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:22.671692 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:22.686746 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] HTTP exception thrown: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Request method failure captured: Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c HTTP/1.1 Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3J3o9VaQj3z_AvmATmEFYYTR36HkOkIf0Q5PBfin7yo2TOXOElajUrCG5kQKmx_cHp-xPfvT_W_7yIc1ghx6elreF_QJ-YFnO0shLF0l6pX_0Gp7ELcqvqBp3M0qitryKRXblUz8gjp1salAVwHjfITbCf86Is_7E6LgtZFJxQEN12w Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:22:22.688455 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_013fccf2797345bf95efcafd089dfcf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}] Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: fe042f088ffb4b7db88cafe05b11808c Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:22:22.690285 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '77065eb8-1786-49a7-b12a-f672a4ff9d6c'} Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:22.691316 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:22:22.692891 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:22:22.694265 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Returning 404 to user: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:22.694265 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-528599f9-2f37-4bc7-aa4d-786b78ecebdc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 404 len: 111 microversion: 2.20 time: 0.031721 Jul 24 01:22:22.694265 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 476/927] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:22 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:22:22.700983 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e6ef9102-53d8-4b8f-88e1-309990f47b79 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '.version_select at 0x7fdf3c1078b0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:22.721035 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e6ef9102-53d8-4b8f-88e1-309990f47b79 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818986989" status: 204 len: 0 microversion: 2.20 time: 0.025581 Jul 24 01:22:22.721619 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 452/928] 10.222.0.42 () {60 vars in 1258 bytes} [Sun Jul 24 01:22:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818986989 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:22:23.352733 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-059cbfd3-fdd3-47d5-a492-8fec72ed65fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'create', calling method: .version_select at 0x7fdf3c09f430>, body: {"keypair": {"name": "tempest-keypair-202279152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBabsNe85xrtq5EnDNF2FipSYqNsyJnmo8VlWCOoRqOA2vqVskeWfwTRjO9phRecgL/hcZtzPwqvxk9VR9VPVY+Gol/EJ4sAVkhPYcb0rP1H4OO/HJ8WaIyoonWVhgmDTQ=="}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:23.367575 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-059cbfd3-fdd3-47d5-a492-8fec72ed65fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Getting quotas for project 013fccf2797345bf95efcafd089dfcf1. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:22:23.371637 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-059cbfd3-fdd3-47d5-a492-8fec72ed65fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Getting quotas for user fe042f088ffb4b7db88cafe05b11808c and project 013fccf2797345bf95efcafd089dfcf1. Resources: {'key_pairs'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:22:23.399511 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-059cbfd3-fdd3-47d5-a492-8fec72ed65fe tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050738 Jul 24 01:22:23.400101 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 477/929] 10.222.0.42 () {62 vars in 1199 bytes} [Sun Jul 24 01:22:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:22:24.670484 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1512325875", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f17bb821-e143-452a-ba5a-d6f407514d96"}], "security_groups": [{"name": "tempest-securitygroup--1604456989"}], "key_name": "tempest-keypair-202279152", "user_data": "}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:24.772571 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.network.neutron [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] validate_networks() for [('f17bb821-e143-452a-ba5a-d6f407514d96', None, None, None, None, None)] {{(pid=118036) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:22:25.160155 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Flavor limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:22:25.160572 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Image limits 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:22:25.161044 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Flavor pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:22:25.161447 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Image pref 0:0:0 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:22:25.161851 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.virt.hardware [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118036) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:22:25.171791 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:25.172230 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:25.173013 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:25.173437 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:25.190079 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Getting quotas for project 013fccf2797345bf95efcafd089dfcf1. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:22:25.194081 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.quota [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Getting quotas for user fe042f088ffb4b7db88cafe05b11808c and project 013fccf2797345bf95efcafd089dfcf1. Resources: {'ram', 'instances', 'cores'} {{(pid=118036) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:22:25.205296 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Going to run 1 instances... {{(pid=118036) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:22:25.207608 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118036) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:22:25.258798 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-332555e7-1d8e-414f-8f74-80e09b755679 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.593579 Jul 24 01:22:25.259603 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 453/930] 10.222.0.42 () {62 vars in 1187 bytes} [Sun Jul 24 01:22:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:22:25.269804 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0eeca203-3ac0-4fd8-bd9d-018653bf02d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:25.270437 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0eeca203-3ac0-4fd8-bd9d-018653bf02d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:25.327728 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0eeca203-3ac0-4fd8-bd9d-018653bf02d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:25.335193 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0eeca203-3ac0-4fd8-bd9d-018653bf02d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:25.336782 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0eeca203-3ac0-4fd8-bd9d-018653bf02d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:25.337954 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0eeca203-3ac0-4fd8-bd9d-018653bf02d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1281 microversion: 2.20 time: 0.072180 Jul 24 01:22:25.338608 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 478/931] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:25 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:22:26.357391 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:26.358003 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:26.365323 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:26.365761 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:26.366519 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:26.367042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:26.445008 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:26.453487 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:26.454979 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:26.456650 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-159643c2-f25f-4340-9433-7b0c74df7236 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1341 microversion: 2.20 time: 0.103973 Jul 24 01:22:26.457216 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 454/932] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:26 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1341 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:27.475544 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:27.476281 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:27.483285 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:27.483802 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:27.484658 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:27.485157 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:27.707965 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:27.716434 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:27.717944 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:27.719090 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f6cedf80-f982-4213-8fd3-630dd6edc128 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1407 microversion: 2.20 time: 0.247702 Jul 24 01:22:27.720053 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 479/933] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:27 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:28.018888 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-74d0b459-542f-4518-9681-62de4dad83ec req-80c5f023-a022-4a94-9642-80c1ad1c4454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b", "tag": "e0ebaf78-7c23-4beb-9464-c8092eb46836"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:28.029254 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-74d0b459-542f-4518-9681-62de4dad83ec req-80c5f023-a022-4a94-9642-80c1ad1c4454 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:28.029752 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-74d0b459-542f-4518-9681-62de4dad83ec req-80c5f023-a022-4a94-9642-80c1ad1c4454 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:28.041881 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-74d0b459-542f-4518-9681-62de4dad83ec req-80c5f023-a022-4a94-9642-80c1ad1c4454 service nova] Creating event network-changed:e0ebaf78-7c23-4beb-9464-c8092eb46836 for instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b on hv-cinder-maste Jul 24 01:22:28.047656 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-74d0b459-542f-4518-9681-62de4dad83ec req-80c5f023-a022-4a94-9642-80c1ad1c4454 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033713 Jul 24 01:22:28.048606 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 455/934] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:28.741817 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:28.742580 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:28.750711 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:28.751237 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:28.752179 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:28.752689 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:28.895001 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:28.903344 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:28.904853 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:28.905921 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-ca63a7f2-8421-4d4e-a737-304655eff9b1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1407 microversion: 2.20 time: 0.170759 Jul 24 01:22:28.906483 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 480/935] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:28 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:29.926034 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:29.926737 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:29.933641 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:29.934091 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:29.934839 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:29.935322 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:30.079337 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:30.087436 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:30.088930 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:30.090048 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d2239b61-d916-4809-877b-9482c6e63090 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1407 microversion: 2.20 time: 0.169026 Jul 24 01:22:30.090582 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 456/936] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:29 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:31.108455 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:31.109135 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:31.116029 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:31.116469 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:31.117278 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:31.117719 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:31.271122 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:31.284238 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:31.286507 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:31.288169 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-f393ef6f-b976-453c-9ab7-001f70c86ae1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1407 microversion: 2.20 time: 0.183551 Jul 24 01:22:31.288977 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 481/937] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:31 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:32.306794 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:32.307556 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:32.314211 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:32.314656 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:32.315460 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:32.315915 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:32.451539 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:32.461551 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:32.462839 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:32.463990 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a01c68ad-daea-46ec-8f95-147ea089b838 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1407 microversion: 2.20 time: 0.161257 Jul 24 01:22:32.464661 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 457/938] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:32 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:33.486469 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:33.487491 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:33.498677 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:33.499499 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:33.500765 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:33.501497 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:33.646089 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:33.656397 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:33.658089 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:33.659390 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-c1f6467a-c9c0-43b9-a3bb-23f417fd6712 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1407 microversion: 2.20 time: 0.179507 Jul 24 01:22:33.659951 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 482/939] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:33 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:33.773701 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-01742032-a0d6-4b81-bdb6-7135ac146ba5 req-8c7b4c23-df32-403c-b484-93d6534945af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b", "name": "network-vif-plugged", "status": "completed", "tag": "e0ebaf78-7c23-4beb-9464-c8092eb46836"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:33.782692 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-01742032-a0d6-4b81-bdb6-7135ac146ba5 req-8c7b4c23-df32-403c-b484-93d6534945af service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:33.783133 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-01742032-a0d6-4b81-bdb6-7135ac146ba5 req-8c7b4c23-df32-403c-b484-93d6534945af service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:33.798574 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-01742032-a0d6-4b81-bdb6-7135ac146ba5 req-8c7b4c23-df32-403c-b484-93d6534945af service nova] Creating event network-vif-plugged:e0ebaf78-7c23-4beb-9464-c8092eb46836 for instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b on hv-cinder-maste Jul 24 01:22:33.800273 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-01742032-a0d6-4b81-bdb6-7135ac146ba5 req-8c7b4c23-df32-403c-b484-93d6534945af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030428 Jul 24 01:22:33.801049 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 458/940] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:22:34.681752 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:34.682326 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:34.689238 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:34.689683 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:34.690438 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:34.690868 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:34.825934 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:34.834199 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:34.835709 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:34.836935 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e164fe2b-501e-41cf-9248-e107b5121115 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1407 microversion: 2.20 time: 0.161006 Jul 24 01:22:34.837503 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 483/941] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:34 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:35.855273 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:35.856072 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:35.859522 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:35.860157 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=6 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:35.864849 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:35.865287 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.866048 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:35.866478 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.998165 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:36.010179 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:36.011750 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:36.012915 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-cff7bacd-9936-4632-a245-61dfb3509589 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1599 microversion: 2.20 time: 0.162142 Jul 24 01:22:36.013471 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 459/942] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:35 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:36.036913 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-bb23b8e8-a9eb-4a62-accc-bd323b4b0713 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:36.037460 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-bb23b8e8-a9eb-4a62-accc-bd323b4b0713 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:36.040101 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=6 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:36.046953 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bb23b8e8-a9eb-4a62-accc-bd323b4b0713 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:36.047440 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bb23b8e8-a9eb-4a62-accc-bd323b4b0713 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:36.048225 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bb23b8e8-a9eb-4a62-accc-bd323b4b0713 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:36.048661 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-bb23b8e8-a9eb-4a62-accc-bd323b4b0713 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:36.128636 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-bb23b8e8-a9eb-4a62-accc-bd323b4b0713 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097063 Jul 24 01:22:36.129235 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 484/943] 10.222.0.42 () {60 vars in 1315 bytes} [Sun Jul 24 01:22:36 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:22:37.331271 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-3e63b82f-c0a5-48d4-b35e-61372431471f req-067a834e-85ee-4ae6-99d1-8a64f3b95298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b", "tag": "e0ebaf78-7c23-4beb-9464-c8092eb46836"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:37.340033 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-3e63b82f-c0a5-48d4-b35e-61372431471f req-067a834e-85ee-4ae6-99d1-8a64f3b95298 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:37.340551 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-3e63b82f-c0a5-48d4-b35e-61372431471f req-067a834e-85ee-4ae6-99d1-8a64f3b95298 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:37.351783 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-3e63b82f-c0a5-48d4-b35e-61372431471f req-067a834e-85ee-4ae6-99d1-8a64f3b95298 service nova] Creating event network-changed:e0ebaf78-7c23-4beb-9464-c8092eb46836 for instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b on hv-cinder-maste Jul 24 01:22:37.356898 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-3e63b82f-c0a5-48d4-b35e-61372431471f req-067a834e-85ee-4ae6-99d1-8a64f3b95298 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029351 Jul 24 01:22:37.357496 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 460/944] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:23:09.875602 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:09.876389 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:09.879202 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:09.880095 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:09.880898 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7551b4e2-5870-408e-8eef-1fe2134744df tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:09.881454 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7551b4e2-5870-408e-8eef-1fe2134744df tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:09.889604 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7551b4e2-5870-408e-8eef-1fe2134744df tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.890065 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7551b4e2-5870-408e-8eef-1fe2134744df tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.890964 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7551b4e2-5870-408e-8eef-1fe2134744df tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.891639 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7551b4e2-5870-408e-8eef-1fe2134744df tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.931428 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7551b4e2-5870-408e-8eef-1fe2134744df tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:23:09.955329 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-a06b53e3-37d8-46c3-83e4-fede12b237c6 req-cb7609c5-f2b6-4ae6-b074-f89260743d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4800d3-ad11-46dd-90db-b763e1944b9e", "tag": "a4e927a5-ea6b-4827-aa7b-42a260b70350"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:09.964478 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a06b53e3-37d8-46c3-83e4-fede12b237c6 req-cb7609c5-f2b6-4ae6-b074-f89260743d5d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.964915 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-a06b53e3-37d8-46c3-83e4-fede12b237c6 req-cb7609c5-f2b6-4ae6-b074-f89260743d5d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.976360 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-a06b53e3-37d8-46c3-83e4-fede12b237c6 req-cb7609c5-f2b6-4ae6-b074-f89260743d5d service nova] Creating event network-changed:a4e927a5-ea6b-4827-aa7b-42a260b70350 for instance cb4800d3-ad11-46dd-90db-b763e1944b9e on hv-cinder-maste Jul 24 01:23:09.981492 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-a06b53e3-37d8-46c3-83e4-fede12b237c6 req-cb7609c5-f2b6-4ae6-b074-f89260743d5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105346 Jul 24 01:23:09.982071 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 461/945] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:10.012723 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7551b4e2-5870-408e-8eef-1fe2134744df tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 204 len: 0 microversion: 2.1 time: 0.138605 Jul 24 01:23:10.016513 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 485/946] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:23:09 2022] DELETE /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:10.022469 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-93ca865e-b885-4bcb-bbfd-8928d78d1d95 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:10.023413 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-93ca865e-b885-4bcb-bbfd-8928d78d1d95 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:10.030886 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-93ca865e-b885-4bcb-bbfd-8928d78d1d95 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:10.031463 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-93ca865e-b885-4bcb-bbfd-8928d78d1d95 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:10.032536 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-93ca865e-b885-4bcb-bbfd-8928d78d1d95 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:10.033036 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-93ca865e-b885-4bcb-bbfd-8928d78d1d95 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:10.186753 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-93ca865e-b885-4bcb-bbfd-8928d78d1d95 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:10.194524 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-93ca865e-b885-4bcb-bbfd-8928d78d1d95 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.176330 Jul 24 01:23:10.195100 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 462/947] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:10 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:11.212892 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-250b7982-3fb1-4e65-a493-65f3e521f1af tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:11.213447 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-250b7982-3fb1-4e65-a493-65f3e521f1af tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:11.219994 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-250b7982-3fb1-4e65-a493-65f3e521f1af tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:11.220435 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-250b7982-3fb1-4e65-a493-65f3e521f1af tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:11.221195 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-250b7982-3fb1-4e65-a493-65f3e521f1af tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:11.221620 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-250b7982-3fb1-4e65-a493-65f3e521f1af tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:11.390784 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-250b7982-3fb1-4e65-a493-65f3e521f1af tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:11.398964 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-250b7982-3fb1-4e65-a493-65f3e521f1af tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1568 microversion: 2.1 time: 0.190506 Jul 24 01:23:11.399537 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 486/948] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:11 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:12.239472 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-2ea538f1-8304-42ba-a68b-83703ec9af40 req-cd216443-2a48-4e4d-a3fa-44cca9a75c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4800d3-ad11-46dd-90db-b763e1944b9e", "name": "network-vif-deleted", "tag": "a4e927a5-ea6b-4827-aa7b-42a260b70350"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:12.247494 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-2ea538f1-8304-42ba-a68b-83703ec9af40 req-cd216443-2a48-4e4d-a3fa-44cca9a75c6b service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:12.247930 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-2ea538f1-8304-42ba-a68b-83703ec9af40 req-cd216443-2a48-4e4d-a3fa-44cca9a75c6b service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:12.258715 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-2ea538f1-8304-42ba-a68b-83703ec9af40 req-cd216443-2a48-4e4d-a3fa-44cca9a75c6b service nova] Creating event network-vif-deleted:a4e927a5-ea6b-4827-aa7b-42a260b70350 for instance cb4800d3-ad11-46dd-90db-b763e1944b9e on hv-cinder-maste Jul 24 01:23:12.263746 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-2ea538f1-8304-42ba-a68b-83703ec9af40 req-cd216443-2a48-4e4d-a3fa-44cca9a75c6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082961 Jul 24 01:23:12.264312 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 463/949] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:12.416460 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3fe524ee-39eb-48f3-a2f0-200c714d37c2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:12.417205 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3fe524ee-39eb-48f3-a2f0-200c714d37c2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:12.424548 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3fe524ee-39eb-48f3-a2f0-200c714d37c2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:12.425099 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3fe524ee-39eb-48f3-a2f0-200c714d37c2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:12.426142 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3fe524ee-39eb-48f3-a2f0-200c714d37c2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:12.426629 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3fe524ee-39eb-48f3-a2f0-200c714d37c2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:12.494775 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3fe524ee-39eb-48f3-a2f0-200c714d37c2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6dd6349c9a467ca7cd5aaf1b9c6a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935463280c7a4d6eaab209974e8b1bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:12.503924 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3fe524ee-39eb-48f3-a2f0-200c714d37c2 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 200 len: 1219 microversion: 2.1 time: 0.091144 Jul 24 01:23:12.504556 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 487/950] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:12 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:13.527394 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:13.528266 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] [instance: cb4800d3-ad11-46dd-90db-b763e1944b9e] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:13.537140 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:13.537736 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:13.538753 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:13.539364 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:13.556031 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] HTTP exception thrown: Instance cb4800d3-ad11-46dd-90db-b763e1944b9e could not be found. Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Request method failure captured: Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e HTTP/1.1 Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3J2oDHucny748KtcPTB8Z0UWmTHwD7gNb1B9xOy9xo1YfaqQmo5XjDACmh3x-CJdWt5WcBtlvrx6lcpUp216vVOYaC3s6z4FQzNqPUCpDQ9lQVfI-DH71vhd_Va2YBrT3FdBQ143muI4A55dcgSFJqvP_K3dwywww3gFhgtZZVLX3DA Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 935463280c7a4d6eaab209974e8b1bf8 Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-TestShelveInstance-1048238147 Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:23:13.557644 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/935463280c7a4d6eaab209974e8b1bf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_935463280c7a4d6eaab209974e8b1bf8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/935463280c7a4d6eaab209974e8b1bf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/935463280c7a4d6eaab209974e8b1bf8"}]}] Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-TestShelveInstance-1048238147 Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 935463280c7a4d6eaab209974e8b1bf8 Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-TestShelveInstance-1048238147 Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-TestShelveInstance-1048238147-project Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 2f6dd6349c9a467ca7cd5aaf1b9c6a07 Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-TestShelveInstance-1048238147-project Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance cb4800d3-ad11-46dd-90db-b763e1944b9e could not be found. Jul 24 01:23:13.559285 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'cb4800d3-ad11-46dd-90db-b763e1944b9e'} Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4800d3-ad11-46dd-90db-b763e1944b9e could not be found. Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:13.560278 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4800d3-ad11-46dd-90db-b763e1944b9e could not be found. Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4800d3-ad11-46dd-90db-b763e1944b9e could not be found. Jul 24 01:23:13.561848 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:23:13.563445 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Returning 404 to user: Instance cb4800d3-ad11-46dd-90db-b763e1944b9e could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:13.563445 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-37cbc7fa-0c1e-4bbc-ba9d-f7551d628bb5 tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e" status: 404 len: 111 microversion: 2.1 time: 0.038447 Jul 24 01:23:13.563445 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 464/951] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:13 2022] GET /compute/v2.1/servers/cb4800d3-ad11-46dd-90db-b763e1944b9e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:13.734328 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4fb934be-756f-4f6b-bf41-206be31ad95c tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] Calling method '.version_select at 0x7fdf3c025820>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:13.754390 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4fb934be-756f-4f6b-bf41-206be31ad95c tempest-TestShelveInstance-1048238147 tempest-TestShelveInstance-1048238147-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-936937939" status: 202 len: 0 microversion: 2.1 time: 0.023925 Jul 24 01:23:13.755023 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 488/952] 10.222.0.42 () {58 vars in 1250 bytes} [Sun Jul 24 01:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-936937939 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:23:40.334954 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:23:40.336095 dv-cinder-master-3-smb devstack@n-api.service[118035]: Sun Jul 24 01:23:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:23:52.510982 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=8 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:52.512211 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=12 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:52.747750 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-2768a55b-2df8-4696-b7fd-c63937c12f77 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:52.748255 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-2768a55b-2df8-4696-b7fd-c63937c12f77 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:52.754732 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2768a55b-2df8-4696-b7fd-c63937c12f77 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:52.755180 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2768a55b-2df8-4696-b7fd-c63937c12f77 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:52.755964 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2768a55b-2df8-4696-b7fd-c63937c12f77 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:52.756395 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-2768a55b-2df8-4696-b7fd-c63937c12f77 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:52.779394 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-2768a55b-2df8-4696-b7fd-c63937c12f77 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/ips" status: 200 len: 152 microversion: 2.20 time: 0.276325 Jul 24 01:23:52.779903 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 465/953] 10.222.0.42 () {60 vars in 1288 bytes} [Sun Jul 24 01:23:52 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/ips => generated 152 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:23:54.555180 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:54.556415 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:54.562882 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7b4435f5-8f05-47f2-9d54-c3cb64e4e9e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:54.563861 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7b4435f5-8f05-47f2-9d54-c3cb64e4e9e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:54.577830 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7b4435f5-8f05-47f2-9d54-c3cb64e4e9e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.578569 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7b4435f5-8f05-47f2-9d54-c3cb64e4e9e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:54.579883 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7b4435f5-8f05-47f2-9d54-c3cb64e4e9e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.580317 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7b4435f5-8f05-47f2-9d54-c3cb64e4e9e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:54.604316 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.objects.instance [None req-7b4435f5-8f05-47f2-9d54-c3cb64e4e9e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lazy-loading 'flavor' on Instance uuid 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b {{(pid=118035) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:23:54.875166 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7b4435f5-8f05-47f2-9d54-c3cb64e4e9e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/action" status: 202 len: 0 microversion: 2.20 time: 0.322428 Jul 24 01:23:54.875829 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 489/954] 10.222.0.42 () {62 vars in 1318 bytes} [Sun Jul 24 01:23:54 2022] POST /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:54.885171 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:54.885741 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:54.893108 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.893646 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:54.894556 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.895019 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:55.029567 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:55.041829 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:55.044553 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:55.046297 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-1fdc177e-fac4-4431-9aaf-05988a5e99f5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.165101 Jul 24 01:23:55.047495 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 466/955] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:54 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:56.071192 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:56.072275 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:56.081852 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:56.082332 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:56.083096 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:56.083568 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:56.223907 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:56.236564 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:56.238813 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:56.240633 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-55f72bbf-99e1-4ae8-ae3f-546c543fef05 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.177176 Jul 24 01:23:56.241372 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 490/956] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:56 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:57.267556 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:57.268147 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:57.275084 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:57.275561 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:57.276317 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:57.276747 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:57.413640 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:57.422204 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:57.423815 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:57.424964 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-5262d92f-6076-429b-9eec-548a08ac77cd tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.163900 Jul 24 01:23:57.425515 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 467/957] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:57 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:58.444636 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:58.445261 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:58.452233 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:58.452689 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:58.453459 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:58.453898 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:58.594560 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:58.603128 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:58.604661 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:58.605832 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d909c7c3-00e6-4ca1-aedc-c081e3720e47 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.165240 Jul 24 01:23:58.606402 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 491/958] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:58 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:59.628303 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:59.629155 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:59.639515 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:59.640259 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:59.641515 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:59.642232 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:59.779615 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:59.790162 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:59.791675 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:59.793200 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-0d64c2d6-0f1e-4e9f-9740-4cdf53f70485 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.171650 Jul 24 01:23:59.793737 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 468/959] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:59 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:00.815741 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:00.816818 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:00.824483 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:00.824932 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:00.825701 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:00.826132 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:00.962777 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:00.971123 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:00.972653 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:00.973831 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-61d17b71-76d7-426f-93ef-adde1755e0e1 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.164641 Jul 24 01:24:00.974403 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 492/960] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:00 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:01.995047 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:01.995861 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:02.004796 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:02.005386 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:02.006388 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:02.006984 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:02.139204 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:02.151345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:02.153558 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:02.155624 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a72912cd-55b7-41e5-ba8f-250d69cd7a10 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.165507 Jul 24 01:24:02.156365 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 469/961] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:01 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:03.180968 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:03.181951 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:03.192960 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:03.193691 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:03.194945 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:03.195724 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:03.342321 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:03.350678 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:03.352206 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:03.353395 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9657fe3d-689c-4dde-951f-5a685a600007 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.179171 Jul 24 01:24:03.353950 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 493/962] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:03 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:04.374351 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:04.374970 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:04.383384 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:04.383874 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:04.384645 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:04.385071 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:04.523076 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:04.531270 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:04.532771 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:04.533926 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a374924c-9411-4be0-8580-fc69904bf911 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.165040 Jul 24 01:24:04.534485 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 470/963] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:04 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:05.556980 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:05.558002 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:05.569199 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:05.569943 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:05.571195 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:05.571967 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:05.712188 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:05.720460 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:05.721946 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:05.723100 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8ad41837-9987-4b7f-8939-9575e1de087b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.172782 Jul 24 01:24:05.723654 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 494/964] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:05 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:06.743537 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:06.744295 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:06.752869 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:06.753422 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:06.754362 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:06.754901 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:06.885650 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:06.894167 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:06.895721 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:06.896883 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-673557e0-301e-42a4-ac41-9be18f1dde1b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1745 microversion: 2.20 time: 0.158489 Jul 24 01:24:06.897408 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 471/965] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:06 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:07.915226 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:07.915838 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:07.923001 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:07.923510 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:07.924273 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:07.924711 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:08.057400 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:08.066103 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:08.067704 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:08.068798 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1bec095a-d9e0-40d4-9985-a7f1b9af3ba4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1745 microversion: 2.20 time: 0.157583 Jul 24 01:24:08.069361 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 495/966] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:07 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:09.091361 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:09.092252 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:09.102613 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:09.103064 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:09.103870 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:09.104300 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:09.237944 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:09.246444 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:09.247975 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:09.249128 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b689c8bc-b540-441d-a10c-3abca061e31c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1745 microversion: 2.20 time: 0.164550 Jul 24 01:24:09.249688 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 472/967] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:09 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:10.267749 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:10.268453 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:10.275674 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:10.276182 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:10.276950 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:10.277467 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:10.388244 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-ac9c5db8-058b-4bce-a9ef-eb94d6756e8a req-2526a20d-1751-4743-80e9-11650e8e6d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b", "name": "network-vif-plugged", "status": "completed", "tag": "e0ebaf78-7c23-4beb-9464-c8092eb46836"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:10.396849 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-ac9c5db8-058b-4bce-a9ef-eb94d6756e8a req-2526a20d-1751-4743-80e9-11650e8e6d25 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:10.397291 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-ac9c5db8-058b-4bce-a9ef-eb94d6756e8a req-2526a20d-1751-4743-80e9-11650e8e6d25 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:10.410264 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-ac9c5db8-058b-4bce-a9ef-eb94d6756e8a req-2526a20d-1751-4743-80e9-11650e8e6d25 service nova] Creating event network-vif-plugged:e0ebaf78-7c23-4beb-9464-c8092eb46836 for instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b on hv-cinder-maste Jul 24 01:24:10.411993 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:10.415438 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-ac9c5db8-058b-4bce-a9ef-eb94d6756e8a req-2526a20d-1751-4743-80e9-11650e8e6d25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097273 Jul 24 01:24:10.416022 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 473/968] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:24:10.420669 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:10.422159 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:10.423385 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-22bea652-9e87-4e4c-ba40-cd75c1f515d0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1745 microversion: 2.20 time: 0.159677 Jul 24 01:24:10.423940 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 496/969] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:10 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:11.446681 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:11.447871 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:11.458494 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.459267 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.460532 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.461297 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.603471 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:11.611510 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:11.613003 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:11.614167 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9c5c2033-bd3c-4218-9882-8fe922c60cb0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1745 microversion: 2.20 time: 0.175354 Jul 24 01:24:11.614724 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 474/970] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:11 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:12.632800 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:12.633491 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:12.640352 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:12.640802 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:12.641569 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:12.641986 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:12.774824 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:12.782914 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:12.784435 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:12.785601 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-fa52170c-e4a8-473a-9aa0-7db965e2dbb4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1740 microversion: 2.20 time: 0.156869 Jul 24 01:24:12.786168 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 497/971] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:12 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:13.805099 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:13.805804 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:13.814237 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:13.815034 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:13.816042 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:13.816991 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:13.965289 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:13.973726 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:13.975230 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:13.976556 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ef05cf53-5ddf-4c24-bed5-35a4e44f1d8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1740 microversion: 2.20 time: 0.175326 Jul 24 01:24:13.977115 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 475/972] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:13 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:14.995925 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:14.997517 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:15.004808 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:15.005573 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:15.006841 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:15.007477 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:15.145209 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:15.153803 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:15.155343 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:15.156639 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-7bc96c26-c5e2-49d9-ae35-6d8b8d7ec86c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1740 microversion: 2.20 time: 0.165207 Jul 24 01:24:15.159346 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 498/973] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:14 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:16.179414 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:16.180227 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:16.187447 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:16.187959 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:16.188940 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:16.189374 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:16.327078 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:16.335628 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:16.337160 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:16.338472 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-f2110545-b807-4d49-b4e4-2ed86f1f5691 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1740 microversion: 2.20 time: 0.163077 Jul 24 01:24:16.350190 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 476/974] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:16 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:17.357324 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:17.357966 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:17.365403 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:17.365840 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:17.366601 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:17.367038 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:17.505234 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:17.521195 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:17.523003 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:17.524951 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-0f6e4972-cbf4-4609-a995-566be305a63f tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1740 microversion: 2.20 time: 0.171705 Jul 24 01:24:17.525835 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 499/975] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:17 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:18.543725 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:18.545043 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:18.552474 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:18.555321 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:18.556191 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:18.556622 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:18.699692 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:18.709628 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:18.711891 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:18.713076 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7fdf1b0a-916a-4101-82bc-894a712ce811 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1740 microversion: 2.20 time: 0.173676 Jul 24 01:24:18.713640 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 477/976] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:18 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:19.731474 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:19.732301 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:19.738864 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:19.739662 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:19.740733 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:19.741371 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:19.909671 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:19.919044 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:19.920604 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:19.921872 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-64240bb4-4c51-45df-92c3-43fff58d93c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1740 microversion: 2.20 time: 0.194745 Jul 24 01:24:19.932650 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 500/977] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:19 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:20.940419 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:20.941686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:20.948560 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:20.949366 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:20.950149 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:20.950582 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:21.096812 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:21.104969 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:21.106758 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:21.109725 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-97900220-6f7d-4d9d-ad88-093ce6a7eac3 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1740 microversion: 2.20 time: 0.173182 Jul 24 01:24:21.110842 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 478/978] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:20 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:22.134105 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:22.134687 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:22.142297 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:22.142838 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:22.143774 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:22.144293 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:22.280421 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:22.288649 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:22.290148 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:22.291367 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-8fb51c0a-3a3a-426e-898e-5f696407b329 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1740 microversion: 2.20 time: 0.164366 Jul 24 01:24:22.291936 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 501/979] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:22 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:23.313635 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:23.314555 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:23.318436 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=29 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:23.327527 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:23.328262 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:23.329520 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:23.330237 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:23.334815 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=79 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:23.466569 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:23.474609 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:23.476126 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:23.477277 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-726c0e05-59ca-425b-b52f-580d5265ebee tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1722 microversion: 2.20 time: 0.170356 Jul 24 01:24:23.477930 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 479/980] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:23 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:24.309350 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-ad2592a1-97f0-477d-8ba1-92c74167b7d4 req-0cbb5f25-204d-4004-b223-237b41111975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b", "name": "network-vif-unplugged", "status": "completed", "tag": "e0ebaf78-7c23-4beb-9464-c8092eb46836"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:24.319366 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ad2592a1-97f0-477d-8ba1-92c74167b7d4 req-0cbb5f25-204d-4004-b223-237b41111975 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.319800 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ad2592a1-97f0-477d-8ba1-92c74167b7d4 req-0cbb5f25-204d-4004-b223-237b41111975 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.331778 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-ad2592a1-97f0-477d-8ba1-92c74167b7d4 req-0cbb5f25-204d-4004-b223-237b41111975 service nova] Creating event network-vif-unplugged:e0ebaf78-7c23-4beb-9464-c8092eb46836 for instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b on hv-cinder-maste Jul 24 01:24:24.336911 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-ad2592a1-97f0-477d-8ba1-92c74167b7d4 req-0cbb5f25-204d-4004-b223-237b41111975 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031265 Jul 24 01:24:24.337717 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 502/981] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:24.498996 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:24.499668 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:24.508068 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.508654 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.509603 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.510143 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.656979 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.665727 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.667580 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.668736 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c1b47da8-380d-49d9-a1c2-2578f00359d5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1722 microversion: 2.20 time: 0.174924 Jul 24 01:24:24.669294 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 480/982] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:24 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:25.688412 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:25.689119 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:25.691070 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=29 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:25.697296 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:25.697743 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:25.698506 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:25.698947 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:25.701942 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:25.833383 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:25.841694 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:25.843189 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:25.844391 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-094fc572-e12a-4175-acaf-f462eac991af tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1665 microversion: 2.20 time: 0.160842 Jul 24 01:24:25.844957 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 503/983] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:25 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:25.862597 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-9e72139c-74b2-496d-82b2-305fc6df2d62 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f541dc38-6977-42be-a54a-4e0f58dbd9ea"}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:25.863670 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-9e72139c-74b2-496d-82b2-305fc6df2d62 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:25.870579 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9e72139c-74b2-496d-82b2-305fc6df2d62 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:25.871023 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9e72139c-74b2-496d-82b2-305fc6df2d62 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:25.871806 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9e72139c-74b2-496d-82b2-305fc6df2d62 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:25.872235 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-9e72139c-74b2-496d-82b2-305fc6df2d62 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.165663 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-9e72139c-74b2-496d-82b2-305fc6df2d62 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306664 Jul 24 01:24:26.166845 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 481/984] 10.222.0.42 () {62 vars in 1363 bytes} [Sun Jul 24 01:24:25 2022] POST /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:24:26.284456 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a07f8ee1-112c-4cf3-8e07-e94d568347dc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:26.285193 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a07f8ee1-112c-4cf3-8e07-e94d568347dc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:26.294831 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a07f8ee1-112c-4cf3-8e07-e94d568347dc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.295467 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a07f8ee1-112c-4cf3-8e07-e94d568347dc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.296624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a07f8ee1-112c-4cf3-8e07-e94d568347dc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.297221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a07f8ee1-112c-4cf3-8e07-e94d568347dc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.546530 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a07f8ee1-112c-4cf3-8e07-e94d568347dc tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/os-volume_attachments/f541dc38-6977-42be-a54a-4e0f58dbd9ea" status: 202 len: 0 microversion: 2.20 time: 0.268565 Jul 24 01:24:26.547315 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 504/985] 10.222.0.42 () {60 vars in 1456 bytes} [Sun Jul 24 01:24:26 2022] DELETE /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/os-volume_attachments/f541dc38-6977-42be-a54a-4e0f58dbd9ea => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:24:26.603327 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-339c4695-f6f9-4882-990c-74008a9e5332 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:26.603921 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-339c4695-f6f9-4882-990c-74008a9e5332 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:26.611123 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-339c4695-f6f9-4882-990c-74008a9e5332 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.611604 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-339c4695-f6f9-4882-990c-74008a9e5332 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.612369 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-339c4695-f6f9-4882-990c-74008a9e5332 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.612799 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-339c4695-f6f9-4882-990c-74008a9e5332 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.699033 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-339c4695-f6f9-4882-990c-74008a9e5332 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "POST /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/action" status: 202 len: 0 microversion: 2.20 time: 0.099951 Jul 24 01:24:26.699673 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 482/986] 10.222.0.42 () {62 vars in 1318 bytes} [Sun Jul 24 01:24:26 2022] POST /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:24:26.708561 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:26.709401 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:26.717342 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.717965 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.718792 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.719388 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.847652 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:26.855576 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:26.857066 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:26.858223 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-206b6616-f302-43a3-bc5b-a410b339d900 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1673 microversion: 2.20 time: 0.154092 Jul 24 01:24:26.858785 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 505/987] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:26 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:27.882661 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:27.884682 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:27.891649 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:27.892095 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:27.892883 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:27.893309 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:28.024782 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:28.032853 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:28.034345 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:28.035505 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7811b89d-58d5-4ad3-8c59-fc5bcb018e7b tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.160407 Jul 24 01:24:28.036085 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 483/988] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:27 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:29.053975 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:29.054589 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:29.062096 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.062546 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:29.063393 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.063774 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:29.218353 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:29.227646 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:29.229534 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:29.231271 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b8eea0b5-e6dd-493e-9750-6957bcd3ab67 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.181130 Jul 24 01:24:29.243098 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 506/989] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:29 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:30.250103 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:30.250913 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:30.258110 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:30.258555 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:30.259347 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:30.259807 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:30.397454 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:30.405670 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:30.407173 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:30.408376 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-7e5dd3f5-3f2f-4b58-a6b2-aa8ddf61166c tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.162306 Jul 24 01:24:30.408941 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 484/990] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:30 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:31.427396 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:31.427982 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:31.434737 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:31.435195 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:31.435976 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:31.436615 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:31.582367 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:31.592060 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:31.593995 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:31.595496 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-dfade6ac-5e3d-4bab-8e1f-b881f90d0c3e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.172206 Jul 24 01:24:31.606262 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 507/991] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:31 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:32.613839 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:32.614571 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:32.621894 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.622441 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.623315 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.623838 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.763794 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:32.772592 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:32.774089 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:32.775444 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c75f2436-ed92-4a1d-b012-400d8af80d0e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.165548 Jul 24 01:24:32.776082 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 485/992] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:32 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:33.796169 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:33.796827 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:33.803398 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.803843 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:33.804624 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.805128 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:33.945339 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.954104 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.955611 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.956780 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-1e0f30fa-e98f-452a-bece-f5bef047a6e4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.166339 Jul 24 01:24:33.957546 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 508/993] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:33 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:34.977781 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:34.978433 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:34.985062 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:34.985534 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:34.986306 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:34.986732 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:35.121570 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:35.129843 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:35.131336 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:35.132529 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-c9106046-a241-4beb-8677-02ce115dfec4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.158804 Jul 24 01:24:35.133089 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 486/994] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:34 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:36.154433 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:36.155354 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:36.164905 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:36.165589 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:36.166758 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:36.167807 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:36.310111 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:36.318564 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:36.320131 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:36.321283 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-02d7b720-5940-4a91-bdbd-9ae41d5aba5d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.173628 Jul 24 01:24:36.321813 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 509/995] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:36 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:37.340201 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:37.340802 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:37.348384 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:37.348838 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:37.349803 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:37.350271 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:37.478619 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:37.487045 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:37.488554 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:37.489702 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-437f01df-aa14-4925-98ee-e8169e234f80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.153571 Jul 24 01:24:37.490271 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 487/996] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:37 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:38.512002 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:38.512749 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:38.521748 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.522383 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:38.523344 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.523956 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:38.656450 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:38.665095 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:38.666686 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:38.668208 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-3d51fe1d-89cc-4622-b857-50ee3b98be8e tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.162528 Jul 24 01:24:38.668775 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 510/997] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:38 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:39.707757 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:39.708414 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:39.716041 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:39.723484 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:39.723484 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:39.723484 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:39.848786 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:39.857288 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:39.858817 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:39.859967 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-43799511-a01f-40a3-85ce-5d9a4c97d088 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.157373 Jul 24 01:24:39.860529 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 488/998] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:39 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:40.882418 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:40.883442 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:40.891506 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.891978 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:40.892782 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.893245 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:41.029129 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:41.042633 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:41.044937 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:41.046723 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-171291be-4640-4e81-a610-98a12d61e233 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.170826 Jul 24 01:24:41.047466 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 511/999] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:40 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:42.072987 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:42.073499 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:42.080513 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:42.080972 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:42.081730 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:42.082165 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:42.212080 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:42.220303 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:42.222093 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:42.222961 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-26034e1d-eb54-4b84-9ae7-8c0af4d187e0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.156672 Jul 24 01:24:42.223571 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 489/1000] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:42 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:43.245743 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:43.246793 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:43.257972 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:43.258722 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:43.260065 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:43.260798 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:43.399232 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:43.407498 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:43.408997 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:43.410176 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-b6641595-2cce-4f27-b528-41ffe7cb3171 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.171236 Jul 24 01:24:43.410712 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 512/1001] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:43 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:44.436349 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:44.436964 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:44.443843 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:44.444284 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:44.445057 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:44.445468 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:44.470741 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-387aaffb-c0d7-4e85-8901-2d700b78ef1b req-fb725489-b5d0-48ea-836a-2cd80bdb5ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b", "name": "network-vif-plugged", "status": "completed", "tag": "e0ebaf78-7c23-4beb-9464-c8092eb46836"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:44.480366 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-387aaffb-c0d7-4e85-8901-2d700b78ef1b req-fb725489-b5d0-48ea-836a-2cd80bdb5ea9 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:44.480815 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-387aaffb-c0d7-4e85-8901-2d700b78ef1b req-fb725489-b5d0-48ea-836a-2cd80bdb5ea9 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:44.493012 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-387aaffb-c0d7-4e85-8901-2d700b78ef1b req-fb725489-b5d0-48ea-836a-2cd80bdb5ea9 service nova] Creating event network-vif-plugged:e0ebaf78-7c23-4beb-9464-c8092eb46836 for instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b on hv-cinder-maste Jul 24 01:24:44.498865 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-387aaffb-c0d7-4e85-8901-2d700b78ef1b req-fb725489-b5d0-48ea-836a-2cd80bdb5ea9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031937 Jul 24 01:24:44.499805 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 513/1002] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:44.871704 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:44.882676 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:44.885203 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:44.887011 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-a4318482-a5f7-4b57-aa76-4d952a29de80 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.454375 Jul 24 01:24:44.887918 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 490/1003] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:44 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:45.911423 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:45.912568 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:45.921857 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:45.922364 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:45.923443 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:45.924068 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:46.062261 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:46.070958 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:46.072564 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:46.073731 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-e3529654-a4fc-458f-8ec8-b686f6229204 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.170144 Jul 24 01:24:46.074331 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 514/1004] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:45 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:47.092395 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:47.093132 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:47.099880 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:47.100325 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:47.101310 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:47.101742 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:47.236166 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:47.244312 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:47.245825 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:47.246970 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-cd9e5dd9-a1c0-49c9-80a6-615c897ec05d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1731 microversion: 2.20 time: 0.158657 Jul 24 01:24:47.247557 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 491/1005] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:47 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:48.267696 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.268318 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:48.275456 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.275901 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.276664 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.277093 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.405267 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:48.413300 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:48.414792 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:48.416095 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a389f81e-b0a7-4b76-bd6e-bcd14a6295cf tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1718 microversion: 2.20 time: 0.154547 Jul 24 01:24:48.416660 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 515/1006] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:48 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:15.439389 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:25:15.440057 dv-cinder-master-3-smb devstack@n-api.service[118036]: Sun Jul 24 01:25:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:25:37.087900 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e2ca40e7-ebc1-40e9-8adb-0c20fce80198 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:37.088922 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-e2ca40e7-ebc1-40e9-8adb-0c20fce80198 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:37.091228 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=27 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:37.091924 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:37.098146 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e2ca40e7-ebc1-40e9-8adb-0c20fce80198 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.098611 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e2ca40e7-ebc1-40e9-8adb-0c20fce80198 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.099393 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e2ca40e7-ebc1-40e9-8adb-0c20fce80198 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.099827 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-e2ca40e7-ebc1-40e9-8adb-0c20fce80198 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.130190 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e2ca40e7-ebc1-40e9-8adb-0c20fce80198 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046353 Jul 24 01:25:37.130729 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 492/1007] 10.222.0.42 () {60 vars in 1342 bytes} [Sun Jul 24 01:25:37 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:37.189537 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-4b3479b2-271e-48c5-8c6d-3c58f0638bd0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:37.190163 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4b3479b2-271e-48c5-8c6d-3c58f0638bd0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:37.192586 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=25 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:37.193248 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:37.199154 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4b3479b2-271e-48c5-8c6d-3c58f0638bd0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.199635 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4b3479b2-271e-48c5-8c6d-3c58f0638bd0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.200405 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4b3479b2-271e-48c5-8c6d-3c58f0638bd0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.200843 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-4b3479b2-271e-48c5-8c6d-3c58f0638bd0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.227855 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-4b3479b2-271e-48c5-8c6d-3c58f0638bd0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Going to try to terminate instance {{(pid=118035) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:25:37.310594 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-4b3479b2-271e-48c5-8c6d-3c58f0638bd0 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 204 len: 0 microversion: 2.20 time: 0.124632 Jul 24 01:25:37.311179 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 516/1008] 10.222.0.42 () {60 vars in 1279 bytes} [Sun Jul 24 01:25:37 2022] DELETE /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:25:37.319562 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:37.320229 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:37.326455 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.326835 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.327620 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.328052 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.464013 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.472664 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.474154 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.475338 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b4e98246-ff62-4105-9bcb-5c0f52f518f4 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.159699 Jul 24 01:25:37.475910 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 493/1009] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:37 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:38.494968 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:38.495660 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:38.502886 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.503340 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.504105 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.504536 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.647896 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.659471 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.661745 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.663805 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-378ca0b7-2b94-4a21-932e-939fb29d5ee7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1724 microversion: 2.20 time: 0.172729 Jul 24 01:25:38.664563 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 517/1010] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:38 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:39.686262 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:39.686845 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:39.693790 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:39.694116 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:39.694895 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:39.695408 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:39.756439 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:39.764484 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:39.765990 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe042f088ffb4b7db88cafe05b11808c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013fccf2797345bf95efcafd089dfcf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:39.767136 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-07e1487d-f3e3-4fd3-baee-26323087cfc5 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 200 len: 1656 microversion: 2.20 time: 0.085109 Jul 24 01:25:39.767763 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 494/1011] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:39 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 1656 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:39.862478 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-2489dc8d-696d-4878-bc32-71f550e511a6 req-e81adbe8-493c-428b-b122-c90187383d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b", "name": "network-vif-deleted", "tag": "e0ebaf78-7c23-4beb-9464-c8092eb46836"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:39.871092 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-2489dc8d-696d-4878-bc32-71f550e511a6 req-e81adbe8-493c-428b-b122-c90187383d44 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:39.871591 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-2489dc8d-696d-4878-bc32-71f550e511a6 req-e81adbe8-493c-428b-b122-c90187383d44 service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:39.883415 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-2489dc8d-696d-4878-bc32-71f550e511a6 req-e81adbe8-493c-428b-b122-c90187383d44 service nova] Creating event network-vif-deleted:e0ebaf78-7c23-4beb-9464-c8092eb46836 for instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b on hv-cinder-maste Jul 24 01:25:39.889168 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-2489dc8d-696d-4878-bc32-71f550e511a6 req-e81adbe8-493c-428b-b122-c90187383d44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030252 Jul 24 01:25:39.889798 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 518/1012] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:40.785881 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:40.786633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:40.794308 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.794701 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.795754 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.795882 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.810270 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] HTTP exception thrown: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Request method failure captured: Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b HTTP/1.1 Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3J3o9VaQj3z_AvmATmEFYYTR36HkOkIf0Q5PBfin7yo2TOXOElajUrCG5kQKmx_cHp-xPfvT_W_7yIc1ghx6elreF_QJ-YFnO0shLF0l6pX_0Gp7ELcqvqBp3M0qitryKRXblUz8gjp1salAVwHjfITbCf86Is_7E6LgtZFJxQEN12w Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:25:40.812247 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_013fccf2797345bf95efcafd089dfcf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}] Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: fe042f088ffb4b7db88cafe05b11808c Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:40.814047 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b'} Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:40.815010 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:40.816597 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:40.818633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Returning 404 to user: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:40.818633 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-008694d1-2476-4a52-ba6e-ebad4520ae08 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 404 len: 111 microversion: 2.20 time: 0.031758 Jul 24 01:25:40.818633 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 495/1013] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:40 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:25:40.827311 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-11fa1cdf-7c85-46eb-97f2-967e154be6c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '.version_select at 0x7fdf3c0298b0>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:40.846813 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-11fa1cdf-7c85-46eb-97f2-967e154be6c6 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202279152" status: 204 len: 0 microversion: 2.20 time: 0.027634 Jul 24 01:25:40.847468 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 519/1014] 10.222.0.42 () {60 vars in 1258 bytes} [Sun Jul 24 01:25:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202279152 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:25:42.609979 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:42.610603 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:42.617419 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:42.617864 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:42.618617 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:42.619049 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:42.633261 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] HTTP exception thrown: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Request method failure captured: Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: DELETE /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b HTTP/1.1 Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3J3o9VaQj3z_AvmATmEFYYTR36HkOkIf0Q5PBfin7yo2TOXOElajUrCG5kQKmx_cHp-xPfvT_W_7yIc1ghx6elreF_QJ-YFnO0shLF0l6pX_0Gp7ELcqvqBp3M0qitryKRXblUz8gjp1salAVwHjfITbCf86Is_7E6LgtZFJxQEN12w Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:25:42.634798 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_013fccf2797345bf95efcafd089dfcf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}] Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: fe042f088ffb4b7db88cafe05b11808c Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.636424 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b'} Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:42.637479 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.638865 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.640457 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Returning 404 to user: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:42.640457 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-3e9b6ee7-6da0-41d2-9438-1ac706a25da7 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 404 len: 111 microversion: 2.20 time: 0.030164 Jul 24 01:25:42.640457 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 496/1015] 10.222.0.42 () {60 vars in 1279 bytes} [Sun Jul 24 01:25:42 2022] DELETE /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:25:42.648703 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:42.649562 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:42.657102 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:42.657549 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:42.658308 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:42.658744 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:42.674619 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] HTTP exception thrown: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Request method failure captured: Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b HTTP/1.1 Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3J3o9VaQj3z_AvmATmEFYYTR36HkOkIf0Q5PBfin7yo2TOXOElajUrCG5kQKmx_cHp-xPfvT_W_7yIc1ghx6elreF_QJ-YFnO0shLF0l6pX_0Gp7ELcqvqBp3M0qitryKRXblUz8gjp1salAVwHjfITbCf86Is_7E6LgtZFJxQEN12w Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:25:42.676268 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_013fccf2797345bf95efcafd089dfcf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}] Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: fe042f088ffb4b7db88cafe05b11808c Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.677945 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b'} Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:42.678927 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. Jul 24 01:25:42.680443 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:42.682004 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Returning 404 to user: Instance 0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:42.682004 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-843d8ed0-91e9-453b-929b-a10181ade03d tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b" status: 404 len: 111 microversion: 2.20 time: 0.036228 Jul 24 01:25:42.682004 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 520/1016] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:42 2022] GET /compute/v2.1/servers/0704f6c8-3ef5-44cf-a0b5-52d19a35fd4b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:25:43.833493 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:43.833991 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:43.840939 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:43.841382 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:43.842133 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:43.842555 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:43.856025 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] HTTP exception thrown: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Request method failure captured: Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: DELETE /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c HTTP/1.1 Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3J3o9VaQj3z_AvmATmEFYYTR36HkOkIf0Q5PBfin7yo2TOXOElajUrCG5kQKmx_cHp-xPfvT_W_7yIc1ghx6elreF_QJ-YFnO0shLF0l6pX_0Gp7ELcqvqBp3M0qitryKRXblUz8gjp1salAVwHjfITbCf86Is_7E6LgtZFJxQEN12w Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:25:43.857587 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_013fccf2797345bf95efcafd089dfcf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}] Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: fe042f088ffb4b7db88cafe05b11808c Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: > Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.859153 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': '77065eb8-1786-49a7-b12a-f672a4ff9d6c'} Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:43.859972 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.861315 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.862828 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Returning 404 to user: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:43.862828 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-74d68101-993e-4fbd-bd1c-435778e19d03 tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 404 len: 111 microversion: 2.20 time: 0.029423 Jul 24 01:25:43.862828 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 497/1017] 10.222.0.42 () {60 vars in 1279 bytes} [Sun Jul 24 01:25:43 2022] DELETE /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:25:43.867389 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:43.868003 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] [instance: 77065eb8-1786-49a7-b12a-f672a4ff9d6c] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:43.874689 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:43.875080 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:43.875877 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:43.876312 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:43.889684 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] HTTP exception thrown: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Request method failure captured: Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c HTTP/1.1 Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3J3o9VaQj3z_AvmATmEFYYTR36HkOkIf0Q5PBfin7yo2TOXOElajUrCG5kQKmx_cHp-xPfvT_W_7yIc1ghx6elreF_QJ-YFnO0shLF0l6pX_0Gp7ELcqvqBp3M0qitryKRXblUz8gjp1salAVwHjfITbCf86Is_7E6LgtZFJxQEN12w Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:25:43.891198 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_013fccf2797345bf95efcafd089dfcf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/013fccf2797345bf95efcafd089dfcf1"}]}] Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: 013fccf2797345bf95efcafd089dfcf1 Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1844586516 Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: fe042f088ffb4b7db88cafe05b11808c Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1844586516-project Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.893058 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': '77065eb8-1786-49a7-b12a-f672a4ff9d6c'} Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:43.893997 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. Jul 24 01:25:43.895534 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:25:43.896872 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] Returning 404 to user: Instance 77065eb8-1786-49a7-b12a-f672a4ff9d6c could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:43.896872 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6f4a7aa4-32d3-4e23-8e0b-aa5cc444d4cb tempest-AttachVolumeShelveTestJSON-1844586516 tempest-AttachVolumeShelveTestJSON-1844586516-project] 10.222.0.42 "GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c" status: 404 len: 111 microversion: 2.20 time: 0.029117 Jul 24 01:25:43.896872 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 521/1018] 10.222.0.42 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:43 2022] GET /compute/v2.1/servers/77065eb8-1786-49a7-b12a-f672a4ff9d6c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:25:48.353715 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-e4cc0548-fef1-4f33-886a-bcb15c924166 tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] Action: 'create', calling method: .version_select at 0x7fdf3c2f1a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-119033785", "metadata": {"Type": "work"}}} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:48.643886 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-e4cc0548-fef1-4f33-886a-bcb15c924166 tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.412156 Jul 24 01:25:48.644974 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 498/1019] 10.222.0.42 () {60 vars in 1155 bytes} [Sun Jul 24 01:25:48 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 414 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 24 01:25:48.655901 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-97be47e8-8a11-46f1-84ea-9d546d4eedcc tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] Calling method '.version_select at 0x7fdf3cbaa940>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:48.708508 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-97be47e8-8a11-46f1-84ea-9d546d4eedcc tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf" status: 200 len: 352 microversion: 2.1 time: 0.055932 Jul 24 01:25:48.709173 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 522/1020] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:25:48 2022] GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:49.726915 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-61ee6278-a904-4900-8d77-5061e5225ee8 tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] Calling method '.version_select at 0x7fdf3c258160>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:49.777574 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-61ee6278-a904-4900-8d77-5061e5225ee8 tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf" status: 200 len: 353 microversion: 2.1 time: 0.058648 Jul 24 01:25:49.778243 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 499/1021] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:25:49 2022] GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:49.794842 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-a70f70f6-9fdb-46a9-b5aa-91a84cb74bfd tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] Calling method '.version_select at 0x7fdf2fec8040>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:49.841386 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-a70f70f6-9fdb-46a9-b5aa-91a84cb74bfd tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf" status: 200 len: 353 microversion: 2.1 time: 0.052348 Jul 24 01:25:49.841957 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 523/1022] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:25:49 2022] GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:49.858071 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-94a238c0-3c71-4060-8870-d0aacb6b90aa tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] Calling method '.version_select at 0x7fdf3c2aeb80>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:49.923636 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-94a238c0-3c71-4060-8870-d0aacb6b90aa tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf" status: 202 len: 0 microversion: 2.1 time: 0.069395 Jul 24 01:25:49.924187 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 500/1023] 10.222.0.42 () {58 vars in 1247 bytes} [Sun Jul 24 01:25:49 2022] DELETE /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:25:49.932793 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-5008b703-f364-4957-b619-f9be517e43e8 tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] Calling method '.version_select at 0x7fdf2fec4e50>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:49.981386 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-5008b703-f364-4957-b619-f9be517e43e8 tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf" status: 200 len: 352 microversion: 2.1 time: 0.052461 Jul 24 01:25:49.981953 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 524/1024] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:25:49 2022] GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:50.998126 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b855b321-8d35-4594-9ab0-fe28b0a1906f tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] Calling method '.version_select at 0x7fdf3c02a3a0>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:51.026654 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.wsgi [None req-b855b321-8d35-4594-9ab0-fe28b0a1906f tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] HTTP exception thrown: Volume d266c257-8e1d-4dc7-97f1-8867f0c67fbf could not be found. Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b855b321-8d35-4594-9ab0-fe28b0a1906f tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] Request method failure captured: Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: request: GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf HTTP/1.1 Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept: application/json Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: Accept-Encoding: identity Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: Connection: close Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Length: 0 Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: Content-Type: application/json Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: Host: 10.222.0.42 Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: Openstack-System-Scope: None Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Auth-Token: gAAAAABi3J-czuj7dpcMVUkvi79xezv5ZlzctCJs2IcrROscLom7iqV_svLx4wkE1sDvo1XPK4SpREN5FVf5w66j5hSWK3i4C0pm7-qB0cQFwiGOF80-9QoGnuLQjzwWsB8rKAz2_tjFZbWeL-f-qGKcLcToMGb9tj9yJ8rBo8C1U-up4KY_iwM Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Id: None Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Domain-Name: None Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Identity-Status: Confirmed Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Is-Admin-Project: True Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Id: default Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Domain-Name: Default Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Id: d3b91c64b4d9409a965b1045f1f47ab0 Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Project-Name: tempest-VolumesGetTestJSON-1552464419 Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Role: reader,member Jul 24 01:25:51.028620 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Roles: reader,member Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d3b91c64b4d9409a965b1045f1f47ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d3b91c64b4d9409a965b1045f1f47ab0", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d3b91c64b4d9409a965b1045f1f47ab0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d3b91c64b4d9409a965b1045f1f47ab0"}]}] Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant: tempest-VolumesGetTestJSON-1552464419 Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Id: d3b91c64b4d9409a965b1045f1f47ab0 Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-Tenant-Name: tempest-VolumesGetTestJSON-1552464419 Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User: tempest-VolumesGetTestJSON-1552464419-project Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Id: default Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Domain-Name: Default Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Id: 712b2dcbd8f944158fa77e3f4b0a86ff Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: X-User-Name: tempest-VolumesGetTestJSON-1552464419-project Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: method: Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: exception: Volume d266c257-8e1d-4dc7-97f1-8867f0c67fbf could not be found. Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: action_args: {'id': 'd266c257-8e1d-4dc7-97f1-8867f0c67fbf'} Jul 24 01:25:51.030276 dv-cinder-master-3-smb devstack@n-api.service[118036]: {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d266c257-8e1d-4dc7-97f1-8867f0c67fbf could not be found. (HTTP 404) (Request-ID: req-00d3f08f-7b69-4c1d-90f8-337adfd8f73d) Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:51.031197 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:25:51.032450 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d266c257-8e1d-4dc7-97f1-8867f0c67fbf could not be found. Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 24 01:25:51.033654 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d266c257-8e1d-4dc7-97f1-8867f0c67fbf could not be found. Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d266c257-8e1d-4dc7-97f1-8867f0c67fbf could not be found. Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: ERROR nova.api.openstack.wsgi Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-b855b321-8d35-4594-9ab0-fe28b0a1906f tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] Returning 404 to user: Volume d266c257-8e1d-4dc7-97f1-8867f0c67fbf could not be found. {{(pid=118036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-b855b321-8d35-4594-9ab0-fe28b0a1906f tempest-VolumesGetTestJSON-1552464419 tempest-VolumesGetTestJSON-1552464419-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf" status: 404 len: 109 microversion: 2.1 time: 0.038423 Jul 24 01:25:51.035120 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 501/1025] 10.222.0.42 () {58 vars in 1244 bytes} [Sun Jul 24 01:25:50 2022] GET /compute/v2.1/os-volumes/d266c257-8e1d-4dc7-97f1-8867f0c67fbf => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:02.941748 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:02.942618 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:02.946862 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1650690788", "imageRef": "2b741074-9a9e-419f-bfb0-0d9d5ab2b002", "flavorRef": "452"}} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:03.000015 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.network.neutron [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] validate_networks() for None {{(pid=118035) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:26:03.276224 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Flavor limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:26:03.276648 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Image limits 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:26:03.277145 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Flavor pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:26:03.277556 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Image pref 0:0:0 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:26:03.277966 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.virt.hardware [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118035) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:26:03.287683 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:03.288134 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:03.288926 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:03.289366 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:03.307137 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Getting quotas for project bf47428691c448a4831a8429eb38c77e. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:26:03.311611 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.quota [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Getting quotas for user 5e9c6f767db54de8a047f903ce11c40d and project bf47428691c448a4831a8429eb38c77e. Resources: {'ram', 'instances', 'cores'} {{(pid=118035) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:26:03.323658 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Going to run 1 instances... {{(pid=118035) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:26:03.325913 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b741074-9a9e-419f-bfb0-0d9d5ab2b002',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118035) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:26:03.371954 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9d4045c6-dae1-4809-b541-4c8da6124624 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.431504 Jul 24 01:26:03.372585 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 525/1026] 10.222.0.42 () {60 vars in 1146 bytes} [Sun Jul 24 01:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:26:03.383174 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ad30afdc-e563-44fd-b2a8-7988011249d9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:03.383905 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ad30afdc-e563-44fd-b2a8-7988011249d9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:03.386323 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_api:SELECT=12 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:03.386926 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell1:SELECT=24 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:03.443614 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-ad30afdc-e563-44fd-b2a8-7988011249d9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:03.450509 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ad30afdc-e563-44fd-b2a8-7988011249d9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1215 microversion: 2.1 time: 0.071700 Jul 24 01:26:03.451079 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 502/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:03 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:04.468424 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-d589bbc7-9b67-49f2-8a75-d31c5cc948ed tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:04.469527 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-d589bbc7-9b67-49f2-8a75-d31c5cc948ed tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:04.477300 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d589bbc7-9b67-49f2-8a75-d31c5cc948ed tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:04.477758 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d589bbc7-9b67-49f2-8a75-d31c5cc948ed tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:04.478541 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d589bbc7-9b67-49f2-8a75-d31c5cc948ed tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:04.479003 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-d589bbc7-9b67-49f2-8a75-d31c5cc948ed tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:04.541436 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-d589bbc7-9b67-49f2-8a75-d31c5cc948ed tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:04.549058 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-d589bbc7-9b67-49f2-8a75-d31c5cc948ed tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1273 microversion: 2.1 time: 0.085099 Jul 24 01:26:04.549590 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 526/1028] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:04 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:05.566136 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-8ede5990-47a7-4581-9222-535c2d340907 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:05.566713 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-8ede5990-47a7-4581-9222-535c2d340907 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:05.573679 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8ede5990-47a7-4581-9222-535c2d340907 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:05.574156 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8ede5990-47a7-4581-9222-535c2d340907 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:05.575072 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8ede5990-47a7-4581-9222-535c2d340907 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:05.575620 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-8ede5990-47a7-4581-9222-535c2d340907 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:05.714910 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-8ede5990-47a7-4581-9222-535c2d340907 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:05.724736 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-8ede5990-47a7-4581-9222-535c2d340907 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1315 microversion: 2.1 time: 0.162397 Jul 24 01:26:05.727193 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 503/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:05 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:06.160927 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-ba6072e8-0f94-4940-a274-afcecb757e6f req-bf3638a9-ee22-4eb6-9931-ae33bf947b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6086890-ceb6-4262-a3ea-ad9b1e290f37", "tag": "37d8758c-3c6f-4a86-ae32-2b4f6d7181e9"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:06.182703 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ba6072e8-0f94-4940-a274-afcecb757e6f req-bf3638a9-ee22-4eb6-9931-ae33bf947b2c service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.183146 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-ba6072e8-0f94-4940-a274-afcecb757e6f req-bf3638a9-ee22-4eb6-9931-ae33bf947b2c service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:06.195254 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-ba6072e8-0f94-4940-a274-afcecb757e6f req-bf3638a9-ee22-4eb6-9931-ae33bf947b2c service nova] Creating event network-changed:37d8758c-3c6f-4a86-ae32-2b4f6d7181e9 for instance a6086890-ceb6-4262-a3ea-ad9b1e290f37 on hv-cinder-maste Jul 24 01:26:06.200313 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-ba6072e8-0f94-4940-a274-afcecb757e6f req-bf3638a9-ee22-4eb6-9931-ae33bf947b2c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048472 Jul 24 01:26:06.200920 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 527/1030] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:06.745290 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-6bbb6057-4421-4cf6-bd7e-d9b16b5b1082 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:06.746205 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-6bbb6057-4421-4cf6-bd7e-d9b16b5b1082 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:06.754703 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6bbb6057-4421-4cf6-bd7e-d9b16b5b1082 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.755145 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6bbb6057-4421-4cf6-bd7e-d9b16b5b1082 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:06.755938 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6bbb6057-4421-4cf6-bd7e-d9b16b5b1082 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.756370 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-6bbb6057-4421-4cf6-bd7e-d9b16b5b1082 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:06.885861 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-6bbb6057-4421-4cf6-bd7e-d9b16b5b1082 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:06.901840 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-6bbb6057-4421-4cf6-bd7e-d9b16b5b1082 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1315 microversion: 2.1 time: 0.162514 Jul 24 01:26:06.902411 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 504/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:06 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:07.923987 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6ce5e5ae-2084-4989-bfca-59d5120d6cb9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:07.924686 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6ce5e5ae-2084-4989-bfca-59d5120d6cb9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:07.931211 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6ce5e5ae-2084-4989-bfca-59d5120d6cb9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:07.931687 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6ce5e5ae-2084-4989-bfca-59d5120d6cb9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:07.932441 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6ce5e5ae-2084-4989-bfca-59d5120d6cb9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:07.932875 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6ce5e5ae-2084-4989-bfca-59d5120d6cb9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:08.073133 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6ce5e5ae-2084-4989-bfca-59d5120d6cb9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:08.080870 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6ce5e5ae-2084-4989-bfca-59d5120d6cb9 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1315 microversion: 2.1 time: 0.164474 Jul 24 01:26:08.081412 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 528/1032] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:07 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:09.098928 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-48a0dc75-64c7-4a95-8f88-1cb43684077a tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:09.099539 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-48a0dc75-64c7-4a95-8f88-1cb43684077a tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:09.106366 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-48a0dc75-64c7-4a95-8f88-1cb43684077a tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:09.106812 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-48a0dc75-64c7-4a95-8f88-1cb43684077a tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:09.107594 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-48a0dc75-64c7-4a95-8f88-1cb43684077a tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:09.108044 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-48a0dc75-64c7-4a95-8f88-1cb43684077a tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:09.234551 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-48a0dc75-64c7-4a95-8f88-1cb43684077a tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:09.242073 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-48a0dc75-64c7-4a95-8f88-1cb43684077a tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1315 microversion: 2.1 time: 0.147709 Jul 24 01:26:09.242633 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 505/1033] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:09 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:10.260324 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-9dc1e12b-6008-4032-b334-16a0a92cb788 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:10.261310 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-9dc1e12b-6008-4032-b334-16a0a92cb788 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:10.269586 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9dc1e12b-6008-4032-b334-16a0a92cb788 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.270026 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9dc1e12b-6008-4032-b334-16a0a92cb788 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.270789 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9dc1e12b-6008-4032-b334-16a0a92cb788 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.271221 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-9dc1e12b-6008-4032-b334-16a0a92cb788 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.420971 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-9dc1e12b-6008-4032-b334-16a0a92cb788 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:10.432880 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-9dc1e12b-6008-4032-b334-16a0a92cb788 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1315 microversion: 2.1 time: 0.176970 Jul 24 01:26:10.433738 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 529/1034] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:10 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:10.896934 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [req-012bcd4c-71e5-449b-b49b-4ca38c846a01 req-0efa9993-c15c-433d-9e6e-b058ab85547f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6086890-ceb6-4262-a3ea-ad9b1e290f37", "name": "network-vif-plugged", "status": "completed", "tag": "37d8758c-3c6f-4a86-ae32-2b4f6d7181e9"}]} {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:10.907557 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-012bcd4c-71e5-449b-b49b-4ca38c846a01 req-0efa9993-c15c-433d-9e6e-b058ab85547f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.908037 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [req-012bcd4c-71e5-449b-b49b-4ca38c846a01 req-0efa9993-c15c-433d-9e6e-b058ab85547f service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.925975 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.compute.server_external_events [req-012bcd4c-71e5-449b-b49b-4ca38c846a01 req-0efa9993-c15c-433d-9e6e-b058ab85547f service nova] Creating event network-vif-plugged:37d8758c-3c6f-4a86-ae32-2b4f6d7181e9 for instance a6086890-ceb6-4262-a3ea-ad9b1e290f37 on hv-cinder-maste Jul 24 01:26:10.931097 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [req-012bcd4c-71e5-449b-b49b-4ca38c846a01 req-0efa9993-c15c-433d-9e6e-b058ab85547f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038225 Jul 24 01:26:10.931710 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 506/1035] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:11.456937 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-912c6726-18bb-46b0-9436-c33d67d2dec4 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:11.457975 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-912c6726-18bb-46b0-9436-c33d67d2dec4 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:11.465040 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-912c6726-18bb-46b0-9436-c33d67d2dec4 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:11.465481 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-912c6726-18bb-46b0-9436-c33d67d2dec4 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:11.466238 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-912c6726-18bb-46b0-9436-c33d67d2dec4 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:11.466671 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-912c6726-18bb-46b0-9436-c33d67d2dec4 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:11.602749 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-912c6726-18bb-46b0-9436-c33d67d2dec4 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:11.610580 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-912c6726-18bb-46b0-9436-c33d67d2dec4 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1315 microversion: 2.1 time: 0.160105 Jul 24 01:26:11.611121 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 530/1036] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:11 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:12.632285 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-edb02a44-5bff-4ac1-86db-f09aec535100 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:12.633110 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-edb02a44-5bff-4ac1-86db-f09aec535100 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:12.640838 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-edb02a44-5bff-4ac1-86db-f09aec535100 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:12.641401 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-edb02a44-5bff-4ac1-86db-f09aec535100 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:12.642300 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-edb02a44-5bff-4ac1-86db-f09aec535100 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:12.642815 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-edb02a44-5bff-4ac1-86db-f09aec535100 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:12.778578 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-edb02a44-5bff-4ac1-86db-f09aec535100 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:12.786400 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-edb02a44-5bff-4ac1-86db-f09aec535100 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1315 microversion: 2.1 time: 0.161215 Jul 24 01:26:12.786973 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 507/1037] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:12 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:13.804115 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-6a47d831-866a-4a57-b121-571836b1fddd tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:13.804760 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-6a47d831-866a-4a57-b121-571836b1fddd tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:13.807269 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=2 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:13.807958 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG dbcounter [-] [118035] Writing DB stats nova_cell0:SELECT=6 {{(pid=118035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:13.814182 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6a47d831-866a-4a57-b121-571836b1fddd tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.814635 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6a47d831-866a-4a57-b121-571836b1fddd tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.815989 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6a47d831-866a-4a57-b121-571836b1fddd tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.815989 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-6a47d831-866a-4a57-b121-571836b1fddd tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.952832 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-6a47d831-866a-4a57-b121-571836b1fddd tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:13.962678 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-6a47d831-866a-4a57-b121-571836b1fddd tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1464 microversion: 2.1 time: 0.162578 Jul 24 01:26:13.963216 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 531/1038] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:13 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:14.003236 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-ed737731-d398-430c-8257-48e0d9a8f498 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:14.003802 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ed737731-d398-430c-8257-48e0d9a8f498 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:14.005860 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG dbcounter [-] [118036] Writing DB stats nova_cell0:SELECT=2 {{(pid=118036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:14.011956 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ed737731-d398-430c-8257-48e0d9a8f498 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:14.012404 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ed737731-d398-430c-8257-48e0d9a8f498 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:14.013179 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ed737731-d398-430c-8257-48e0d9a8f498 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:14.013633 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-ed737731-d398-430c-8257-48e0d9a8f498 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:14.039613 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-ed737731-d398-430c-8257-48e0d9a8f498 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Going to try to terminate instance {{(pid=118036) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:26:14.126233 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-ed737731-d398-430c-8257-48e0d9a8f498 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 204 len: 0 microversion: 2.1 time: 0.126637 Jul 24 01:26:14.126872 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 508/1039] 10.222.0.42 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:13 2022] DELETE /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:26:14.135309 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-003d6498-f70d-48f6-b596-1964040791df tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:14.135933 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-003d6498-f70d-48f6-b596-1964040791df tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:14.142161 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-003d6498-f70d-48f6-b596-1964040791df tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:14.142672 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-003d6498-f70d-48f6-b596-1964040791df tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:14.143466 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-003d6498-f70d-48f6-b596-1964040791df tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:14.143911 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-003d6498-f70d-48f6-b596-1964040791df tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:14.276029 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.policy [None req-003d6498-f70d-48f6-b596-1964040791df tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118035) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:14.283685 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-003d6498-f70d-48f6-b596-1964040791df tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1470 microversion: 2.1 time: 0.152182 Jul 24 01:26:14.284225 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 532/1040] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:14 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:15.307536 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-d1b7be03-8b07-4124-bcd4-95d48b68012e tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:15.308717 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-d1b7be03-8b07-4124-bcd4-95d48b68012e tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:15.319845 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d1b7be03-8b07-4124-bcd4-95d48b68012e tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:15.320596 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d1b7be03-8b07-4124-bcd4-95d48b68012e tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:15.321862 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d1b7be03-8b07-4124-bcd4-95d48b68012e tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:15.322742 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-d1b7be03-8b07-4124-bcd4-95d48b68012e tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:15.460980 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-d1b7be03-8b07-4124-bcd4-95d48b68012e tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:15.469030 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-d1b7be03-8b07-4124-bcd4-95d48b68012e tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1470 microversion: 2.1 time: 0.168807 Jul 24 01:26:15.469597 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 509/1041] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:15 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:16.223883 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [req-f1abd244-c5c0-49f0-9fa5-f68df2645ef4 req-4f069af3-d07e-4a5a-a621-59b194039f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6086890-ceb6-4262-a3ea-ad9b1e290f37", "name": "network-vif-deleted", "tag": "37d8758c-3c6f-4a86-ae32-2b4f6d7181e9"}]} {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:16.233055 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-f1abd244-c5c0-49f0-9fa5-f68df2645ef4 req-4f069af3-d07e-4a5a-a621-59b194039f3d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.233537 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [req-f1abd244-c5c0-49f0-9fa5-f68df2645ef4 req-4f069af3-d07e-4a5a-a621-59b194039f3d service nova] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.245893 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.compute.server_external_events [req-f1abd244-c5c0-49f0-9fa5-f68df2645ef4 req-4f069af3-d07e-4a5a-a621-59b194039f3d service nova] Creating event network-vif-deleted:37d8758c-3c6f-4a86-ae32-2b4f6d7181e9 for instance a6086890-ceb6-4262-a3ea-ad9b1e290f37 on hv-cinder-maste Jul 24 01:26:16.251103 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [req-f1abd244-c5c0-49f0-9fa5-f68df2645ef4 req-4f069af3-d07e-4a5a-a621-59b194039f3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030928 Jul 24 01:26:16.251760 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 533/1042] 10.222.0.42 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:16.486398 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.api.openstack.wsgi [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:16.487135 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.compute.api [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118036) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:16.496157 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.496779 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.497818 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.498257 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.533686 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.534134 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG oslo_concurrency.lockutils [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.534572 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.objects.instance [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lazy-loading 'fault' on Instance uuid a6086890-ceb6-4262-a3ea-ad9b1e290f37 {{(pid=118036) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:26:16.577198 dv-cinder-master-3-smb devstack@n-api.service[118036]: DEBUG nova.policy [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c6f767db54de8a047f903ce11c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf47428691c448a4831a8429eb38c77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118036) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:16.585034 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO nova.api.openstack.requestlog [None req-58049523-e8f1-4235-b494-d27041a6e49f tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 200 len: 1305 microversion: 2.1 time: 0.102861 Jul 24 01:26:16.585607 dv-cinder-master-3-smb devstack@n-api.service[118036]: [pid: 118036|app: 0|req: 510/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:16 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:17.607115 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Calling method '>' {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:17.608288 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.compute.api [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] [instance: a6086890-ceb6-4262-a3ea-ad9b1e290f37] Fetching instance by UUID {{(pid=118035) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:17.617599 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.618044 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.618797 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.619214 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG oslo_concurrency.lockutils [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Lock "f0485860-44f6-4783-97a7-f4dbef82a919" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.632654 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.wsgi [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] HTTP exception thrown: Instance a6086890-ceb6-4262-a3ea-ad9b1e290f37 could not be found. Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Request method failure captured: Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: request: GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 HTTP/1.1 Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept: application/json Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: Accept-Encoding: identity Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: Connection: close Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Length: 0 Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: Content-Type: application/json Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: Host: 10.222.0.42 Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: Openstack-System-Scope: None Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Auth-Token: gAAAAABi3J-pcmShoCvTQhYgwQMFOktrfUTxDoRvzcfcb9jYChpBvcQnamLLzkMbQMM8ndKdCEvs6X00Ul_bCIii25lXqM3CkMF4KGpq9Js65iLNz3pZK9snonPwff4gl81B2064aCBbZmdrZYAi-E6VnOCaJ9BMP6wzeEHaW0cq6YwQmwe1XAg Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Id: None Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Domain-Name: None Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Identity-Status: Confirmed Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Is-Admin-Project: True Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Id: default Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Domain-Name: Default Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Id: bf47428691c448a4831a8429eb38c77e Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Project-Name: tempest-VolumesNegativeTest-1719382469 Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Role: reader,member Jul 24 01:26:17.634233 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Roles: reader,member Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bf47428691c448a4831a8429eb38c77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bf47428691c448a4831a8429eb38c77e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf47428691c448a4831a8429eb38c77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf47428691c448a4831a8429eb38c77e"}]}] Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant: tempest-VolumesNegativeTest-1719382469 Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Id: bf47428691c448a4831a8429eb38c77e Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-Tenant-Name: tempest-VolumesNegativeTest-1719382469 Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User: tempest-VolumesNegativeTest-1719382469-project Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Id: default Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Domain-Name: Default Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Id: 5e9c6f767db54de8a047f903ce11c40d Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: X-User-Name: tempest-VolumesNegativeTest-1719382469-project Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: method: > Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: exception: Instance a6086890-ceb6-4262-a3ea-ad9b1e290f37 could not be found. Jul 24 01:26:17.636018 dv-cinder-master-3-smb devstack@n-api.service[118035]: action_args: {'id': 'a6086890-ceb6-4262-a3ea-ad9b1e290f37'} Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: {{(pid=118035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6086890-ceb6-4262-a3ea-ad9b1e290f37 could not be found. Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:17.637086 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6086890-ceb6-4262-a3ea-ad9b1e290f37 could not be found. Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6086890-ceb6-4262-a3ea-ad9b1e290f37 could not be found. Jul 24 01:26:17.638623 dv-cinder-master-3-smb devstack@n-api.service[118035]: ERROR nova.api.openstack.wsgi Jul 24 01:26:17.640107 dv-cinder-master-3-smb devstack@n-api.service[118035]: DEBUG nova.api.openstack.wsgi [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] Returning 404 to user: Instance a6086890-ceb6-4262-a3ea-ad9b1e290f37 could not be found. {{(pid=118035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:17.640107 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO nova.api.openstack.requestlog [None req-480ce669-6620-407d-941a-81643f01b833 tempest-VolumesNegativeTest-1719382469 tempest-VolumesNegativeTest-1719382469-project] 10.222.0.42 "GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37" status: 404 len: 111 microversion: 2.1 time: 0.036281 Jul 24 01:26:17.640107 dv-cinder-master-3-smb devstack@n-api.service[118035]: [pid: 118035|app: 0|req: 534/1044] 10.222.0.42 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:17 2022] GET /compute/v2.1/servers/a6086890-ceb6-4262-a3ea-ad9b1e290f37 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:28:21.139587 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:28:21.140676 dv-cinder-master-3-smb devstack@n-api.service[118035]: Sun Jul 24 01:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:28:35.450924 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:28:35.451893 dv-cinder-master-3-smb devstack@n-api.service[118036]: Sun Jul 24 01:28:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:28:40.351127 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:28:40.352068 dv-cinder-master-3-smb devstack@n-api.service[118035]: Sun Jul 24 01:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:29:00.520080 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:29:00.520673 dv-cinder-master-3-smb devstack@n-api.service[118036]: Sun Jul 24 01:29:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:29:02.655075 dv-cinder-master-3-smb devstack@n-api.service[118035]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:29:02.656030 dv-cinder-master-3-smb devstack@n-api.service[118035]: Sun Jul 24 01:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:30:20.928938 dv-cinder-master-3-smb devstack@n-api.service[118036]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:30:20.929738 dv-cinder-master-3-smb devstack@n-api.service[118036]: Sun Jul 24 01:30:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!